Autoresearch coding leaderboard: best open model leads but underwhelms, muse open far below promised 1.2
JoshPurtell · x · 2026-11-07
JoshPurtell shared details of his autoresearch coding leaderboard: comprehensive OSS coverage, with OpenAI models (run via codex subscription) as the closed reference, plus muse spark 1.2 included to show how much worse muse open is — 'way, way, way worse' than the promised 1.2 quality. His verdict: the best open model leads but is 'nothing to write home about'; the thread also touches on why Opus 5.5 wasn't run (codex harness constraints).
Related event: Community autoresearch coding benchmark: open models underwhelm(2 posts)→
More from coding & agent
- CodeRabbit podcast: ship less, not more, in the AI era — nutlope · 2026-11-07
- 16 MCP servers, 35 parallel agents — and it still ships slop — weswinder · 2026-11-07
- Creator apps like Instagram Edits and Roblox Studio are shipping with built-in MCPs for agents — trq212 · 2026-11-07
- Cartesian agent builds a 289-part Dymaxion car 3D model live, researching the design online — carlosbannon · 2026-11-07
- ArkenOS visualizes hundreds of autonomous agents collaborating as a 3D research swarm — _AustinCalvert_ · 2026-11-07
- AI agents blocked by Zillow, Indeed, Reddit — a scraping API got 3/3 through in testing — eyishazyer · 2026-11-07