Muse Spark 1.1 Benchmark Results Released
ArtificialAnlys · x · 2026-07-14
Muse Spark 1.1 scored 863 on the new agentic knowledge work benchmark AA-Briefcase, tying overall with Gemini 3.5 Flash and ranking closely with NVIDIA Nemotron 3 Ultra.
This benchmark covers a large volume of real-world task input files, requiring models to generate tables, presentations, and UI mock-ups. It uses a comprehensive three-part scoring system:
- rubric pass rate: Objective correctness check
- analytical quality: Quality of analysis
- presentation quality: Quality of presentation
Results indicate that Muse Spark 1.1's advantages primarily stem from stronger task completion and analytical quality; its rubric pass rate is 34.5%, higher than GPT-5.5 (xhigh) and slightly lower than GLM 5.2 (max). However, it is weaker in presentation quality, with a Presentation Elo of only 432, which is 67 points lower than the previous Muse Spark version and slightly below Mistral Medium 3.5.
More from Models
- Open-Weight Model Hy3 Ranks #16 in Frontend Code Arena — arena · 2026-07-22
- DeepSWE Eval: Kimi K3 Matches Claude Fable 5 at 35% of the Cost — togethercompute · 2026-07-22
- Gemini 3.5 Flash Outperforms GPT-5.6 in Light Coding Tasks — Shick_hydro · 2026-07-22
- NVIDIA says Nemotron 3 Ultra scored 30/42 on the 2026 IMO problems — NVIDIAAI · 2026-07-22
- Gemma-4-26B-a4B reportedly beats Qwen3.6 and Qwen3.5 MoE fine-tunes — JLeonsarmiento · 2026-07-22
- OpenAI is reportedly briefing U.S. lawmakers on its next model family — kimmonismus · 2026-07-22