Token-based pricing was invented by OpenAI — it may not exist in 2 years
NoSecond8807 · reddit · 2026-08-22
The author argues that token-based pricing is not a natural law but a mechanic OpenAI made up fairly recently that the industry copied. It carries real problems:
- Different models consume/produce vastly different token counts for the same compute input
- Different hardware has different energy efficiency for the same output
- Different energy sources mean different input costs
Token pricing masks all of this, making it hard for consumers to judge value for money — which is exactly why foundation model providers like licensing by the token. But since nothing mandates this model, alternatives like Neuralwatt with totally different pricing are gaining traction. The takeaway: don't bet the farm on anything in this fast-moving space, including whether token math exists at all in a few years.
More from AGI Musings
- Ex-OpenAI interpretability lead: neurons in trillion-param models are mostly legible now — CatAstro_Piyush · 2026-10-16
- Inference engine team says they're in a real RSI loop: faster engine helps build faster engine — cephaloform · 2026-10-16
- FDA pays small company to build a grading system for AI-written radiology reports — YvesMulkers · 2026-10-16
- 'If we developed AI in the 1800s, people would demand ASI to cure diabetes' — zetalyrae · 2026-10-16
- AI trained on the fraction of human intelligence that fit the page — r0ck3t23 · 2026-10-16
- Alignment researcher Turn_Trout blasts AI assistants scraping private Signal chats without consent — Turn_Trout · 2026-10-16