GPT-3 training reportedly hit loss spikes after scraping a microwave-noise subreddit
gabriberton · x · 2026-09-30
Fun AI lore: GPT-3's training reportedly had loss spikes because a crawl included a subreddit dedicated to microwave noises — that batch was literally text like 'mmmmmmmmmmmmmmm'. The author jokes the best way to slow down AI is to write 'brrrr' on Reddit.
More from Fun
- The 🙏 emoji: tech's shorthand for an entire corporate apology — xiao_ted · 2026-09-30
- "No man ever eats the same slop bowl twice" — Lao Tzu, apparently — var_epsilon · 2026-09-30
- Meme Benchmark: Models Asked to Draw the Mona Lisa in SVG with 11,890 Editable Paths — alexcovo_eth · 2026-09-30
- Every Major AI Company Has an Argentinian in the Mix, and It's No Coincidence — evilrabbit_ · 2026-09-30
- Elon Musk reportedly spends $20M on a domain just to troll Sam Altman — pswider · 2026-09-30
- AI-generated "rockstar" images go viral as the latest absurd AI meme — Kalex8876 · 2026-09-30