SolidGoldMagikarp: the bizarre GPT-2 token that broke ChatGPT in 2023
nptacek · x · 2026-11-10
A classic NLP anecdote resurfaces: 'SolidGoldMagikarp' was a real token in GPT-2's vocabulary, originating from a Reddit r/counting username. With almost no meaningful context in training data, early-2023 ChatGPT gave bizarre replies when asked about it—a landmark case of anomalous tokens triggering weird model behavior.
More from Fun
- Agent draws an oriole's nest stroke by stroke: Fable 5.2's first hand-drawn piece uses 30,000 marks — RileyRalmuto · 2026-11-10
- One-shot WW2 shooter with destructible environments wows users as Spawn adopts Fable 5.2 — TAbrodi · 2026-11-10
- Yacine mocks $2M RL env contracts that teach LLMs 'how to kill people' — yacineMTB · 2026-11-10
- The 'Anthropic is elf tech, OpenAI is dwarf tech' meme making the rounds — shakoistsLog · 2026-11-10
- Bought Claude Max expecting 5x longer sessions, ended up running 5 tasks in parallel — tristanbob · 2026-11-10
- Viewers spot noticeable AI "grain" in Ramayana Director's Cut — EXM7777 · 2026-11-10