OpenAI chief scientist shares rare pretraining numbers, says algorithmic research may automate before alignment by 2027
sjgadler · x · 2026-11-23
OpenAI chief scientist Jakub Pachocki published "Perplexity and Intelligence", an unusually transparent release sharing concrete pretraining progress numbers and arguing for shared safety bars based on perplexity and other measurements, with further progress gated on our ability to understand AI behavior.
Commenters highlight a key claim: algorithmic pretraining research is verifiable and likely to be automated by 2027 — before alignment/monitoring research. The essay also argues that AI participation in pretraining algorithmic research itself may drive a step change, beyond the usual "full recursive self-improvement" framing.
More from Models
- Claude formalizes GRH proof approach in 17M lines of Lean, code checks out — elonmusk · 2026-11-23
- 'You're Routed to Opus 4.6': Matthew Berman's Model-Routing Surprise Moment — MatthewBerman · 2026-11-23
- Reddit Hands-on With inkling-mini-2: Coherent and Careful, but Overly Cautious — Express_Quail_1493 · 2026-11-23
- Matt Wolfe: Google Is Back With Its New AI Model — Weekly AI News Roundup — Matt Wolfe · 2026-11-23
- Google's AI Overview triggers on single letter but not complex queries — VeredShwartz · 2026-11-23
- Voyager releases open-source shot-reader-8b multimodal model on Hugging Face — ravisparikh · 2026-11-23