Xeophon discusses the ECI benchmark's creation and what works with its creators
xeophon · x · 2026-11-20
Xeophon talks with Clara Collier and Alex Barry4 about the Extended Creation Index (ECI): how it was created, what works (and what doesn't), and the modern eval landscape.
Related event: Epoch Researchers Break Down How the ECI Benchmark Was Built(2 posts)→
More from Models
- 10 hands-on lessons on what actually happens inside an AI after you type a prompt — techartist_ · 2026-11-20
- Redwood questions Google reusing safety results from weaker model for stronger Carbon — YvesMulkers · 2026-11-20
- GTE-MLM sparse embedding models now natively supported in Transformers v5 — tomaarsen · 2026-11-20
- Reddit user mocks ChatGPT voice mode replying only 'Mm-hmm' at $20 for 3 hours — JackieFiest · 2026-11-20
- GPT-6.2 Sol and Astra top RWE-Bench on cost-efficiency, moving the Pareto frontier — Jsevillamol · 2026-11-20
- Gemini Carbon shows sharp confidence swings in science work, users say — arjunrajlab · 2026-11-20