Base Model Perplexity Regains Spotlight as Community Notes a Return to 2023

The community is debating a resurgence of ranking models by base pretraining perplexity, with @eliebakouch noting base log perplexity strongly predicts Epoch and OpenAI capability metrics, while others caution the landscape has changed since 2023.

2026-11-23 ~ 2026-11-23 · 2 related posts