Xbench turns Twitter into an AI eval, tracking real sentiment and model switches
thedealdirector · x · 2026-09-06
nicochristie built Xbench, treating X posts as a rolling 7-day eval: sentiment tracking, actual model/harness switching data, head-to-head matrices (Codex vs Claude Code), opponent-adjusted preference, and extracted reasons — all linked to source tweets. He flags biases: anti-Anthropic mood on X, potential manufactured hype around Grok Bot from interested parties, and the finding that stated preference tracks price more than intelligence.
More from Models
- Dexmal's open-source VLA model DM0.5 lands in LeRobot, tops RoboColiseum — AdinaYakup · 2026-10-23
- Gemini tip: enable agentic video understanding for ~90% lower token usage — patloeber · 2026-10-23
- Weekly AI cybersecurity roundup: PHP2Shell tops millions of attack attempts, 12 incidents ranked by severity — Dan_Jeffries1 · 2026-10-23
- Open-model advocates push back on blames that abliterated LLMs drive vulnerability surge — max_paperclips · 2026-10-23
- Fable usage limits aren't gone—the mobile app just got a usage-reset UI update — imjustnewatai · 2026-10-23
- Claude generates an 11-minute doomer film entirely in code: 'We will not ask twice' — ZeroStateReflex · 2026-10-23