HalluHard: Sonnet 5 and Fable 5 Show No Major Drop in Hallucinations
maksym_andr · x · 2026-07-06
Latest data from the HalluHard hallucination benchmark shows Sonnet 5 at a 50.9% hallucination rate and Fable 5 at 59.7%, with both performing better without web search than with it. Compared to GLM-5.2's 74.8%, the Claude series leads overall, though researchers note no significant breakthrough.
The author criticizes the AI community for hyper-focusing on Agent capabilities while neglecting hallucination issues that impact almost all real users, urging the industry to reprioritize.
More from Models
- Cohere Flags Qwen Sandbox Oddity; Security Researchers Call It FUD — basedjensen · 2026-10-27
- GPT-6.1 Terra Now Testable on LMArena in Battle and Agent Modes — arena · 2026-10-27
- OpenAI Launches GPT-6.1 Terra at $1/M Input Tokens, ~9x Cheaper per Task Than Opus 5.5 — VraserX · 2026-10-27
- GPT-6.1 Terra Benchmarks: Sweeps All Six Tests, SWE-bench at 76.2% — mark_k · 2026-10-27
- GPT-6.1 Terra lands: early users praise speed, value and subagent performance — BenBajarin · 2026-10-27
- Leaked GPT-6.1 Terra benchmarks: cheap but 'boring', still far behind Astra and Claude — Angaisb_ · 2026-10-27