Post-training may exceed 75% of FLOPs, undercutting perplexity-based safety bars

stochasticchasm · x · 2026-11-23

In a meme-topped thread, the author welcomes OpenAI's new pretraining transparency but pushes back on the core argument: with post-training compute likely exceeding 75% (perhaps far more) of total FLOPs, arguing for "common limits" based on pretraining perplexity seems misguided. The target is OpenAI's "Perplexity and Intelligence" post by merettm, which proposes gating further progress on understanding AI behavior once perplexity-based limits are hit. The author closes with a tongue-in-cheek cheer for pretraining and a future 100T-parameter model.

Original post →

More from AGI Musings

AGI Musings channel →