Why has the AI industry not standardized a billing tokenizer?
JoshPurtell · x · 2026-11-07
Two claims: tokenization is so cheap that the industry lacking a single billing tokenizer is 'unserious' — with Anthropic's tokenizer often inflating counts; and demand distortion means users not paying true marginal cost drift toward inefficient usage patterns.
More from Infra
- Epoch AI: Huawei's largest China AI data center holds just 7% of Colossus 2's compute — Jsevillamol · 2026-11-07
- Musk says SpaceX will launch StarMind orbital supercomputers from Q3 2027, co-designed with NVIDIA — XFreeze · 2026-11-07
- Netflix builds ontology-driven observability: telemetry, incidents and services as one knowledge graph — JeremyCMorgan · 2026-11-07
- Google buys Crusoe's Wyoming data center site as hyperscaler takeover of neoclouds begins — SumitGup · 2026-11-07
- Oracle Down 66% From Peak, 301 Days After Michael Burry Went Short — kingslyj · 2026-11-07
- AI supplier multiples fall ~15% post-selloff, below analyst growth forecasts — BenBajarin · 2026-11-07