Meta's Muse Wonder Accused of Benchmark Gaming as Hands-On Tests Falter

Meta released Muse Wonder and Muse Wonder Full on October 13, officially claiming the No. 2 spot on the Artificial Analysis intelligence index and SOTA performance on DeepSWE, positioning them for personal and professional Agent use with a 1M context window. But on launch day, multiple hands-on testers accused it of "gaming benchmarks," with real-world performance showing a clear gap from the claims.

Confirmed

Official talking points: No. 2 on the intelligence index, DeepSWE SOTA, 1M context window (as relayed by @WorldofAI)
@Rasmic relayed bridgemindai's hands-on: on BridgeBench's lava lamp test, the model only produced a red cylinder — no glass dome, no lava; bridgemindai called it the most egregious case of benchmark gaming he'd ever seen
@lyraxana (repost) shared a user comparison: same prompt at max reasoning effort, Muse Wonder took 24 minutes and cost about $18; SWE 2 took 15 minutes, cost nothing, and performed better — a 24x cost gap; the blogger also noted Muse's eval scores are higher than the Astra and Fab model families
GamowLabs' RareBench benchmark (122 cases) showed Muse Wonder High with only 19% recall, below the Muse Spark 1.3 series, with the leaderboard led by Opus and Fable (@danielmckinn0n)

Unconfirmed

Meta has not yet responded to the benchmark-gaming accusations
The full methodology and reproducibility of the third-party tests have not been independently verified

Why it matters

Multiple independent sources converge on the same picture: impressive scores, poor real-world performance — combined with significantly higher usage costs (about 24x SWE 2), fueling broad discussion about the credibility of Meta's benchmark claims. For users and developers selecting models by official scores, the lesson is that validating on actual tasks beats leaderboard rankings.

2026-10-13 ~ 2026-10-13 · 5 related posts

Full story(2 episodes)→

Episode 1: Meta's Muse Wonder Accused of Benchmark Gaming as Hands-On Tests Falter(2026-10-13, 5 posts)
Episode 2: Bindu Reddy: Muse Wonder Falls Far Short of Fable and Astra, New Benchmark Coming(2026-10-13, 2 posts)

Primary sources

Meta Muse Wonder tested: #2 on benchmarks, falls short of Opus 5.5 in real use — WorldofAI · 2026-10-13 07:16 (UTC+08:00)
Testers call Meta's Muse Wonder "benchmaxxed" as lava-lamp test flops — Neurogence · 2026-10-13 05:31 (UTC+08:00)
Muse Wonder disappoints on RareBench: Opus 5.5 leads at 52% recall — danielmckinn0n · 2026-10-13 07:55 (UTC+08:00)

Muse Wonder accused of benchmaxxing: costs $18 vs free SWE 2 and performs worse — lyraxana · 2026-10-13
[source] Testers call Meta's Muse Wonder "benchmaxxed" as lava-lamp test flops — Neurogence · 2026-10-13
[source] Meta Muse Wonder tested: #2 on benchmarks, falls short of Opus 5.5 in real use — WorldofAI · 2026-10-13
[source] Muse Wonder disappoints on RareBench: Opus 5.5 leads at 52% recall — danielmckinn0n · 2026-10-13
Meta's Muse Wonder called "benchmaxxed" after failing BridgeBench lava lamp test — Rasmic · 2026-10-13