Muse Wonder accused of benchmaxxing: costs $18 vs free SWE 2 and performs worse
lyraxana · x · 2026-10-13
Side-by-side tests of Muse Wonder vs SWE 2 (same prompt, max reasoning): Muse took 24 minutes and $18, while SWE 2 finished in 15 minutes at zero cost — and did better. Users note Muse scores above Astra and Fable 5.1 on benchmarks yet underperforms both, calling it the most benchmaxxed model they've seen.
More from Models
- Hugging Face researcher admits the decision index now faces MTEB's leaderboard-gaming problem — antoine_chaffin · 2026-10-13
- Half of Google's AI releases stuck in Experimental/Preview state, community mocks quality — scaling01 · 2026-10-13
- Anthropic accused of pressuring cloud providers to pull retired Sonnet 3 models for no clear reason — repligate · 2026-10-13
- Dev says Codex is now 'nearly unusable': 4x slower than Opus 5.5 with worse results — TJLarkin23 · 2026-10-13
- oQe Quantization Update Cuts Code KL Divergence by Up to 18% Across 69 Models — huggingface · 2026-10-13
- Allen AI's TutorMoments Benchmark Finds LLM Tutors Over-Help Students — allen_ai · 2026-10-13