Is a point on the ECI near 120 worth one near 170? Benchmark methodology debate kicks off
TheDavidSJ · x · 2026-11-06
David SJ questions Epoch AI's ECI: without evidence that a point near 120 equals a point near 170, using ECI deltas to discuss AI capability speed-ups may be meaningless—sparking a debate with Peter Wildeford and a synthetic-data demonstration.
More from Research
- SynthFaces: Arc2Face diffusion plus flow matching build balanced synthetic face dataset — Sergey Karpukhin · 2026-11-06
- Stable AI proposes DPDM: frozen LLM representations plus shared predictor boost agent decisions — stable-ai · 2026-11-06
- Toby Ord: before RLVR, big pre-trains drove most sudden capability jumps — tobyordoxford · 2026-11-06
- DePue: the cited papers each describe very different phenomena — willdepue · 2026-11-06
- OpenAI researcher: 800M-model intuitions are useless for GPT-6-scale training — willdepue · 2026-11-06
- Lightwheel and Synopsys bring CAE-grade contact physics into robot simulation — lukas_m_ziegler · 2026-11-06