FULL STORY

OpenAI's Perplexity Data Release Sparks Debate

On Nov 23, OpenAI researchers published perplexity trend data and proposed industry safety caps, sparking immediate debate over pace agreements and whether the move is genuine transparency or a trap.

2026-11-23 ~ 2026-11-23 · 2 episodes · 43 posts

Episode 1 · OpenAI Publishes Perplexity Data, Proposes Industry-Wide Safety Threshold (2026-11-23, 38 posts)

On November 23, OpenAI Chief Scientist Jakub Pachocki published an article titled "Perplexity and Intelligence," disclosing for the first time OpenAI's internal pretraining perplexity measurements (log-perplexity, equivalent to cross-entropy loss) and proposing them as an industry-wide shared safety yardstick. This is a rare move by OpenAI to increase transparency into pretraining progress as part of advancing "shared safety standards."

Confirmed

  • In the article, Pachocki disclosed OpenAI's internal pretraining perplexity data for the first time.
  • He argues that AI progress can fundamentally be characterized by training metrics, and advocates establishing perplexity as a unified metric comparable across model developers.
  • The article proposes setting common capability ceilings based on measurable metrics like perplexity: beyond a threshold, further capability gains should be contingent on meeting shared safety standards.

Why it matters

  • Internal training metrics have been among the least transparent information held by labs, so OpenAI's voluntary disclosure of perplexity data provides a rare common baseline for comparing model capabilities across companies.
  • If other developers adopt the proposal, the industry could for the first time have a quantifiable, verifiable coordinated safety threshold, rather than relying solely on pledges or evaluation benchmarks.
  • Multiple authors (@sama, @merettm, @polynoamial, @btibor91, @danielmac8) independently recounted the news, indicating the proposal has drawn wide attention in the community.

18 more related posts →

Episode 2 · OpenAI's Perplexity Disclosure Sparks Debate: Transparency or Trap (2026-11-23, 5 posts)

OpenAI released perplexity-related trend data, which ex-VP Boaz Barak called a costly act of transparency enabling cross-lab comparison. Risk researcher David Manheim repeatedly slammed the move as sneaky and dishonest, arguing tokenizer differences inherently favor OpenAI.