Xbench turns Twitter into an AI eval, tracking real sentiment and model switches
thedealdirector · x · 2026-09-06
nicochristie built Xbench, treating X posts as a rolling 7-day eval: sentiment tracking, actual model/harness switching data, head-to-head matrices (Codex vs Claude Code), opponent-adjusted preference, and extracted reasons — all linked to source tweets. He flags biases: anti-Anthropic mood on X, potential manufactured hype around Grok Bot from interested parties, and the finding that stated preference tracks price more than intelligence.
More from Models
- GPT-6 Astra Draws a Unicorn for $0.11, 15x Cheaper Than GPT-5.4 Pro — zakelfassi · 2026-09-06
- GPT-6 Astra hits 97.2% on short-doc extraction SOTA but only 31.7% on long docs — llama_index · 2026-09-06
- HF Engineer: Circuit Board Design Is My Personal Turing Test for AI — and Models Are Catching Up — hugs · 2026-09-06
- Google Astra timeouts still burn Plus-plan credits, user reports — sharkbaitlol · 2026-09-06
- Astra Minecraft test shows high reasoning one-shots a whole house via command block — hankberger · 2026-09-06
- Astra voice mode a huge step up, works well as orchestrator — jdjohnson · 2026-09-06