Rumor: Gemini 4 is a 12T-param MoE with 500B active; ChatGPT translation fumbles it
teortaxesTex · x · 2026-11-19
A circulating rumor claims Gemini 4 is roughly a 12T-total-parameter MoE model with 500B active parameters (12T-A500B); several North American labs are believed to be at 10T scale too. Back-of-envelope math: with 300T training tokens, 1.2x compute overhead, 30% MFU and 1 month of training, you'd need roughly 300k–400k B300 GPUs.
The poster asked ChatGPT Web to translate the source article and it bombed: it misread "12TA500B" as "12T params trained on 500B tokens", then invented a justification before admitting it "invented an interpretation of technical notation and presented it as fact". His verdict: worse than Google Translate and free DeepSeek — subscription-cancelling bad.
More from Fun
- Benchmark paper naming is saturated, per one satirical lineage — HanchungLee · 2026-11-19
- Cybersecurity in 2026, as told by an xkcd sandwich meme — emax · 2026-11-19
- She vibecoded her own photobooth with Claude Code — and shared the prompt — toolstelegraph · 2026-11-19
- The Zvi on GTA 6's 99 Metacritic score: 'Welcome to 2026. We need better benchmarks.' — NathanpmYoung · 2026-11-19
- LLM-assisted re-scoring of 72 GTA VI reviews finds critics' own complaints imply 92.8, not 98.6 — PAstynome · 2026-11-19
- Meme mocks Karpathy's "AGI is a decade away" prediction as aging like milk — dejavucoder · 2026-11-19