Base log perplexity is an extremely strong predictor of Epoch and OpenAI ECI, researchers note

stochasticchasm · x · 2026-11-23

A tweet thread on whether we're past the era where base-model perplexity determines everything: one poster quipped it feels nostalgically like 2023 again, since we're supposedly beyond that. @eliebakouch countered with a chart showing base log perplexity remains an extremely strong predictor of both Epoch and OpenAI ECI benchmarks. The original poster conceded the correlation looks pretty strong.

Original post →

More from Models

Models channel →