Inference Costs Halved but Quotas Tightened?
mark_k · x · 2026-07-12
This post questions a claim about OpenAI:
> "OpenAI engineers just halved its inference costs."
The author finds it ironic because, simultaneously, many on X are complaining that OpenAI has tightened the usage limits for GPT-5.6, making it feel like "inference is getting more expensive."
Citing The Information, the post notes that OpenAI engineers halving inference costs is their closely guarded "secret weapon," fearing that leaks would allow other labs to optimize their own costs.
Related event: GPT-5.6 Sol Silently Nerfed, OpenAI Confirms Rollback(8 posts)→
More from Infra
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27
- Selling a 5090 to scale local inference: one business weighs 5 hardware paths — Anarchaotic · 2026-10-27
- AWS tutorial: fleet-wide edge CV model lifecycle with SageMaker SDK v3, ~$0.07 per run — AWS ML Blog · 2026-10-27
- Qwen3.8-27B hits 40 tok/s on Jetson Thor with INT4 + MTP, accuracy beats FP16 — No-Dragonfly6246 · 2026-10-27
- Celesto launches CI runners nearly 90% cheaper than GitHub Actions, with agent sandboxes — aniketmaurya · 2026-10-27