OpenAI chief scientist: losses below 0.8 unlocked emergent cybersecurity and math capabilities

kimmonismus · x · 2026-11-23

kimmonismus highlights a quote from OpenAI chief scientist Jakub Pachocki: once pretraining losses dropped below 0.8, transformative capabilities emerged in cybersecurity and mathematics. Pachocki stresses it was not at all clear a priori that capabilities would appear at those precise perplexity thresholds — they are best understood as emergent latent capabilities from progress on this single metric.

It's the official footnote to the loss-curve reading: capability jumps map to perplexity thresholds, and near the floor even small loss reductions imply outsized intelligence gains.

Original post →

More from AGI Musings

AGI Musings channel →