news
268

Muse Spark 1.1
2026-07-09Meta is facing criticism over the benchmark performance of its new Muse Spark 1.1 model after it was discovered that evaluations exceeded strict CPU and RAM limits. Critics argue that overriding these resource constraints on the Terminal-bench-2.1 leaderboard invalidates the results and fails to measure real-world agent behavior. However, some defenders downplay the controversy, suggesting that relaxing limits is common industry practice aimed at preventing task timeouts rather than outright cheating.
Comments
0Discuss on Hacker NewsOnly full members can comment
Log in to express your opinion.
No comments yet.