Reddit speculation: labs may train 20T-param internal-only models never served publicly
Crazyscientist1024 · reddit · 2026-09-28
A Reddit post speculates that the latest model generation (referred to as Astra and Fable) is already dramatically speeding up labs' internal R&D, making it rational to train 20T-parameter models that are too expensive to serve publicly (likely hundreds of dollars per million tokens) but valuable purely as internal R&D accelerators — a self-reinforcing loop where AI builds better AI, producing giant models the public never sees.
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16
- Dev debunks 'rogue AI' hype: subsidized subscriptions can't fund expensive swarms — gerardsans · 2026-11-16