Meta Muse Spark 1.3 takes #2 on ProgramBench at rock-bottom cost
jyangballin · x · 2026-09-30
ProgramBench's author announces results for Meta Muse Spark 1.3: on a benchmark where a SWE-agent must write whole programs (sqlite, ffmpeg, php) from scratch, 1.3 (max) ranks #2 overall and 1.3 (xhigh) #3, at remarkable cost tiers—"intelligence too cheap to meter." Detailed profiles and trajectories are open-sourced.
Related event: Meta Muse Spark 1.3 Ranks Second on ProgramBench with Open Evaluation Data(2 posts)→
More from coding & agent
- Generic API-catalog MCP server vs one tool per job: a context-bloat experiment — MandeepKaur9407 · 2026-11-16
- Berkeley paper: LLMs answer with stale values even when the update is in context — ombre-ai · 2026-11-16
- skills-gate: one gate skill fronts 148 agent skills at just 389 tokens — Distinct-Pie2389 · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- shadcn boosts @uisdk: one-shot UI rebuild that's instantly E2E-testable by AI — shadcn · 2026-11-16
- AI agent deletes 43,599 lines of OpenClaw test code in one PR — vincent_koc · 2026-11-16