Muse Ember's knowledge is its weak spot: 21.1% accuracy but half the hallucination rate of Claude Haiku 5.5

ArtificialAnlys · x · 2026-11-10

Follow-up in Artificial Analysis' Muse Ember thread: knowledge is the model's main weakness — 21.1% on AA-Omniscience accuracy, the lowest among comparable models (vs 34.7% for Claude Haiku 5.5 max). The low score mostly reflects that it declines to answer 64% of questions, which keeps its hallucination rate at 17.4%, half of Claude Haiku 5.5's. Includes full per-benchmark charts.

Related event: Artificial Analysis Reviews Meta's Muse Ember: Matches Haiku 5.5 at One-Third the Cost(17 posts)→

Original post →

More from Models

Models channel →