news
173

A new FrontierHarness Eval tested 22 coding-agent harnesses across 5 models on the same 62 tasks, running each combination four times for 27,280 total runs. The best-value harness differed for every model, and cost rankings shifted substantially depending on the model. With the model held fixed, the most expensive harness cost 1.8 to 5.0 times as much per task as the cheapest.

Only full members can comment

Log in to express your opinion.

No comments yet.