Questioning the 'Months Behind' Metric: Fable's Surprising Jump Suggests a Larger Gap
connoraxiotes · x · 2026-07-22
Tyler M. John problematizes the commonly used 'months behind' metric for measuring the gap between open and closed models. He points out that Fable demonstrated a surprising capability jump from a fresh pre-train, which likely means the actual gap is larger than widely perceived.
More from Models
- OpenAI Presence appears to be a limited enterprise deployment product — btibor91 · 2026-07-22
- Kimi K3 is called roughly equivalent to Opus 4.8 on ALE-Bench — scaling01 · 2026-07-22
- Tencent Hunyuan’s Hy3 ranks #25 in Agent Arena and #2 among open models in Frontend Code Arena — arena · 2026-07-22
- Frontier models are becoming planners, while cheap models handle execution — bigdata · 2026-07-22
- Three prompts behind 47 n8n and Claude agents — Aiden_Tech_Ai · 2026-07-22
- Reddit user says Microsoft’s Mageflow 4B blocks famous-character prompts — krigeta1 · 2026-07-22