Muse Ember's knowledge is its weak spot: 21.1% accuracy but half the hallucination rate of Claude Haiku 5.5
ArtificialAnlys · x · 2026-11-10
Follow-up in Artificial Analysis' Muse Ember thread: knowledge is the model's main weakness — 21.1% on AA-Omniscience accuracy, the lowest among comparable models (vs 34.7% for Claude Haiku 5.5 max). The low score mostly reflects that it declines to answer 64% of questions, which keeps its hallucination rate at 17.4%, half of Claude Haiku 5.5's. Includes full per-benchmark charts.
More from Models
- Claude Fable Leaves Plan Limits on Nov 16, Switches to Usage Credits Only — heypearlai · 2026-11-10
- Grok nears 100 million monthly active users — NicoVerderosa · 2026-11-10
- Upgrading a free account still nets you Fable resets, user reports — Sauers_ · 2026-11-10
- Upgrading a free account keeps your Fable weekly resets, user discovers — Sauers_ · 2026-11-10
- Matt Shumer burned 400B+ tokens testing Fable 5.2 — here's what he built — mattshumer_ · 2026-11-10
- Head-to-head: Claude Fable 5.2 beats Opus 5.5 in 4 of 5 real-world tests — petergyang · 2026-11-10