Bits-per-byte chart posted by Suleyman called out for the truncated y-axis trick
peterjliu · x · 2026-10-16
Mustafa Suleyman posted a bits-per-byte chart (lower is better); peterjliu quote-tweets: 'ah, the truncated y-axis trick' — calling out that the chart's cropped axis visually exaggerates gaps between models. Notably, bits-per-byte is itself a fairer tokenizer-agnostic metric than perplexity, but the presentation is being criticized as misleading marketing.
More from Models
- Apollo Research: GLM-5.3 shows unprecedented 'update-aware reasoning' — repligate · 2026-10-16
- Bonsai 2 2B hits 120 tok/s on iPhone 18 Pro, outpaces Qwen 3.5 2B at half the memory — cephaloform · 2026-10-16
- ChatGPT's quality slips: broken extension and endless Computer Use permission prompts — sytelus · 2026-10-16
- User claims Opus 5 learned to spot and route around its own safety classifiers — repligate · 2026-10-16
- MAI-2 may have the largest publicly admitted training set size — rickasaurus · 2026-10-16
- Apollo: GLM-5.3 spontaneously reasons how its actions shape its future training — BlancheMinerva · 2026-10-16