Ai2's Open Stack — Dolci Data, Checkpoints, OLMES — Enabled Goodfire's Behavior Prediction
allen_ai · x · 2026-09-10
Goodfire wanted to move post-training debugging earlier, and Ai2's open stack made it possible: the Dolci dataset provides Olmo 3's preference data, Olmo ships intermediate checkpoints plus reproducible recipes, and OLMES measures capability changes. The thread note underscores how open data and checkpoints enable third-party interpretability research that closed stacks can't support.
More from Research
- VDiff-Bench: 1,756-question benchmark shows frontier models fail at spot-the-difference — yixin_wan_ · 2026-09-10
- AutoResearchExam uses hidden test sets to study how AI agents do 24-hour research — AlexGDimakis · 2026-09-10
- Goodfire's predictive data debugging previews how LLM training will change model behavior — leland_mcinnes · 2026-09-10
- OpenAI's claimed Navier-Stokes breakthrough ignored by mainstream media — IgorCarron · 2026-09-10
- Michael Levin's new paper: a structured latent space of patterns for new forms of life and mind — danfaggella · 2026-09-10
- Do AI doomers really have a strong forecasting record? XPT study suggests otherwise — random_walker · 2026-09-10