Gemini 4 Hydrogen bench table: leads on HLE-Diamond and agent evals, trails Claude Sonnet 5.5 on some
fofrAI · x · 2026-11-13
fofrAI tried Gemini 4 Hydrogen, calling it "fun and fast," and shared Google's official comparison table vs Claude Sonnet 5.5 and GPT-6.1 Terra. Hydrogen leads on SWE-sweep (13.5%), Agents' Last Exam (71.6%), AutomationBench-AA (76.1%), Vending-Bench 2 ($14,549), and HLE-Diamond (58.8%), but trails Sonnet 5.5 on Terminal-Bench 4.1 (57.0% vs 63.9%), OSWorld-2.1, and Terminal-Bench-Science.
Related event: Gemini 4 Hydrogen Benchmarks Leak with 13.5% on SWE-sweep(3 posts)→
More from Models
- Inkling 2 Small available on Nebius Token Factory from day 0 — Arindam_1729 · 2026-11-13
- Raon-1 nano tops consumer-GPU agent tests: 96/96 tasks, 187 tok/s at ~2GB Q4 — Kangwook_Lee · 2026-11-13
- Same harness, same rules: Argon used the code graph in 12/17 sessions, Opus only 4/17 — rseroter · 2026-11-13
- Massive eval table update benchmarks open-weight models across coding, finance, legal — siyan_zhao · 2026-11-13
- Did Kimi K3 and DeepSeek-V4-Pro each train on 2,000-3,000 Blackwells? Claim disputed — teortaxesTex · 2026-11-13
- Community notes: Ling's Blackwell usage was an open secret, papers admitted renting compute — teortaxesTex · 2026-11-13