Benchmarking Latest Models: Claude Leads Single-Lab Tests, Compound Wins on Value

peterjliu · x · 2026-11-17

peterjliu's team benchmarked the latest models, including "Gemini Carbon," finding a notable gap in knowledge work capabilities like PowerPoint tasks — though one could argue Google doesn't care since it has Slides. Looking at single-lab harnesses, Claude clearly leads, but if you care about your time and money, the author recommends Compound.

Related event: IC Deck Bench Launches: Claude Leads in IC-Grade PPT Generation(3 posts)→

Original post →

More from Models

Models channel →