He pitched pretraining-inference compute exchange rate research 9 months before o1
RylanSchaeffer · x · 2026-10-20
Rylan Schaeffer reveals he pitched studying the exchange rate between pretraining and inference scaling to Ethan Perez in Jan 2024 — nine months before OpenAI's o1 launched — building on Andy Jones's scaling paper. He also worked on AI alignment at Berkeley's Constellation, showing universal jailbreaks seemed difficult-if-not-impossible for multimodal inputs. Lesson: pursue your convictions about the future.
More from AGI Musings
- Preprint maps 280 conserved fibrosis enhancers via CRISPRi CROP-seq across 549,767 cells — anshulkundaje · 2026-10-20
- Viral jab: Anthropic's hypothetical $200B public benefit fund would prioritize stopping Anthropic — birchlse · 2026-10-20
- Jason Wei: AI won't automate radiologists — elastic demand beats displacement — _jasonwei · 2026-10-20
- Language is lossy compression: a long thread argues Neuralink removes the straw entirely — r0ck3t23 · 2026-10-20
- Study: Generative AI boosts creativity only for high-metacognition users, zero gain for others — korymath · 2026-10-20
- "There are no robot foundation models, just foundation models" — tkipf · 2026-10-20