OpenAI uses ~20% compute for inference during training
eliebakouch · x · 2026-08-19
Tweet discusses compute allocation during model training. OpenAI mentioned 20% of "inference compute" (likely including RL training) is used for training, evaluation, and internal usage. The author hopes other labs share similar monitoring and deployment data.
Related event: Frontier Labs Spend 10–20% of Compute on Training Monitoring and Inference(2 posts)→
More from Infra
- Qwen 3.8 in 4-bit hits 25 tok/s on an M3 Max — fully usable locally — AIandDesign · 2026-08-19
- Hygon Profit Soars; LG Partners with Nvidia for Humanoid Robot — 创业邦 · 2026-08-19
- Building Real Offline AI: Local Agent with Cognitive Loops — HotEstablishment7184 · 2026-08-19
- Vercel KMS Lets You Sign JWTs Without Managing Private Keys — cramforce · 2026-08-19
- Ling-3.0-tiny Runs 128K Context on $249 8GB Orin Nano — Puzzleheaded_Base302 · 2026-08-19
- Apple's Foundation Model Framework: Hybrid AI Routing with Dynamic Profiles — Scobleizer · 2026-08-19