Greenblatt: 3x jump in model depth points to architecture changes, not scaling
RyanGreenblatt · x · 2026-09-04
Pushing back on a claim that a new model's reasoning depth is "within a factor of 2 of GPT-4," Ryan Greenblatt argues the gain is mostly architecture-driven: open-weight scaling trends suggest a 3x depth increase would normally require 81x more parameters (equivalent to >6000x more compute), so something beyond normal scaling must be at play.
Related event: Greenblatt: 3x Depth Gain Comes From Architecture, Not Parameter Scaling(4 posts)→
More from Models
- Andrew Curran posts apparent GPT-6 benchmark chart, unverified — carlbfrey · 2026-09-04
- Small humanizer model beats v4 at long-form prose, exceeding expectations — ctjlewis · 2026-09-04
- Cheap model writes 700 solid words; jailbreak "tax" drops from $50 to near zero — ctjlewis · 2026-09-04
- Yoav Goldberg: cheapest run burns ~6-7M tokens per game, mostly reasoning — yoavgo · 2026-09-04
- GPT-6 Astra reportedly scores 100% on ExploitBench, finds two zero-days in testing — VraserX · 2026-09-04
- AI launch playbook under fire: influencer hype chorus vs paying users locked out — xeophon · 2026-09-04