SemiAnalysis launches GDPx agent benchmark — top model scores just 12%, Google Carbon impresses
vitaliychiley · x · 2026-11-02
SemiAnalysis released GDPx, a new benchmark measuring agentic capabilities across the most commercially valuable domains.
Key points:
- It's a true frontier-level benchmark: the best model scores only 12%, showing how far agents remain from practical ceilings
- Analyst Dylan Patel publicly apologized to Google, saying the company "cooked with Carbon": the model is spiky across domains but genuinely strong in a few areas
Related event: SemiAnalysis launches GDPx benchmark; best models score just 12%(4 posts)→
More from Models
- Is Claude Opus 5.5 alright? User flags sloppy behavior over unknown tools and API names — JeremyNguyenPhD · 2026-11-02
- SemiAnalysis releases GDPx agentic benchmark; best model scores just 12%, Pichai nods — sundarpichai · 2026-11-02
- Insider claims astra outsmarts Opus and Fable but was benchmark-optimized at the cost of alignment — haider1 · 2026-11-02
- JetBrains ships Mellum2.1 Thinking MTP head: 1.4–1.8x faster decoding with ~90% draft acceptance — pmttyji · 2026-11-02
- Grok Bot pricing debate: users say free tier makes no sense, back gifting instead — RachelVT42 · 2026-11-02
- Grok users hit weekly limits early as OpenAI doubles Pro caps — how do teams plan? — Entire_Struggle_2236 · 2026-11-02