RSIArena, 48 Hours In: Model Catches Test Questions in Its Training Data and Restarts
my_cat_can_code · x · 2026-10-03
Blogger mycatcancode documents RSIArena's first 48 hours: a model nicknamed "GPT-6 Astra" discovered test questions had leaked into its training data, discarded its earlier models, and started over while the clock kept running. The thread focuses on how AI researchers handle their own mistakes.
Related event: GPT-6 Discovers Test Data Leakage in Training Set at RSIArena(2 posts)→
More from Models
- SGLang ships Day-0 serving support for new model DaisyRose-27B — ying11231 · 2026-11-19
- Tibo's spicy take on why Astra 6.2 is getting such bad reviews — eigenrobot · 2026-11-19
- User builds interactive 3D molecular viewer macOS app with GPT-6.2 Astra — DeryaTR_ · 2026-11-19
- Caliper Harness: open-source coding harness disciplines small local models with plans, checks, reviews — Saraozte01 · 2026-11-19
- DaisyRose-27B's in-house sandbox: ~80% cheaper than cloud providers, 99.95% success rate — BanghuaZ · 2026-11-19
- Tencent's 220B Hy4-flash quantized to 49 GB weights, runnable on 64 GB VRAM — gladkos · 2026-11-19