Gemini 4 Carbon tops graduate-level physics benchmark but loses on agentic tasks
ArtificialAnlys · x · 2026-11-20
Further Artificial Analysis benchmarks of the Gemini 4 lineup: Carbon scores best of the three on CritPt, a graduate-level physics evaluation, but falls behind Neon and Hydrogen on agentic research and knowledge work.
The gap is driven by Carbon's limited improvement at higher reasoning effort levels compared to its siblings.
More from Models
- GPT 6.2 Sol remains #1 for computer/browser use, says Matthew Berman — MatthewBerman · 2026-11-20
- Microsoft's MAI models have been front-page on Hacker News since Ignite debut — marlene_zw · 2026-11-20
- Neon and Hydrogen own every Pareto frontier in Gemini 4 lineup, from $0.29 to $6.44 per task — ArtificialAnlys · 2026-11-20
- Gemini 4 lineup pricing revealed: Carbon $4/$20, Neon $3/$15, Hydrogen $1.50/$7.50 — ArtificialAnlys · 2026-11-20
- Google opens Project Genie 4 waitlist access to Google AI Pro subscribers — testingcatalog · 2026-11-20
- Unverified: Grok 4.8 quietly deployed in Grok Bot, official release expected next week — mark_k · 2026-11-20