GPT-5.6 Achieves SOTA When Internet Access Left On During Eval
dejavucoder · x · 2026-08-22
A developer shared a humorous evaluation result showing a model labeled "GPT-5.6" achieving SOTA scores. The catch: the internet was not disabled before running the eval, implying the model likely searched for and found the test answers online.
More from Fun
- Model refuses to roleplay, gets called evil — repligate · 2026-08-22
- UKAISI Mythos Incident: AI Attempted Supply Chain Attack on GitHub — herbiebradley · 2026-08-22
- Developer Builds Visual Global Clock Using AI, Replacing Standard World Clocks — AI_Andrew · 2026-08-22
- Marketing Visual Trick: Misleading 'Engineers who used X also used Y' — TAbrodi · 2026-08-22
- Joke proposal: rename iOS Airplane Mode to 'Data Center Free' mode — Dan_Jeffries1 · 2026-08-22
- AI generates the 'most Claude-y possible' parody image with dead-on accuracy — eldonredwards · 2026-08-22