Was the Perplexity Comparison Dishonest? Anthropic's Tokenizer Made It Unfair

davidmanheim · x · 2026-11-23

davidmanheim presses on motive: did the perplexity-comparison blog not know Anthropic's tokenizer made the comparison unfair, or did it just not want to suggest a less dishonest comparator? The reply: bits per byte fixes that, it's just a less catchy number.

The exchange exposes a real issue in industry perplexity benchmarks: each lab reports numbers in its own tokenizer, inherently favoring itself; bits per byte is the fairer unit but lacks punch.

Related event: Perplexity Cross-Model Comparison Dispute Prompts Response from Boaz Barak(5 posts)→

Original post →

More from Research

Research channel →