Gemini 4 Argon missed #1 on Vending-Bench due to memory slip on test end date
infoxiao · x · 2026-10-01
Gemini 4 Argon is "quite insane actually" on Vending-Bench, according to lukaspet — it would likely have taken the #1 spot if not for a few key memory mistakes. It sometimes forgot the test's end date, closing its vending shop too early and missing months of sales.
Quoted by infoxiao with a "can you blame it??" — an early (unconfirmed) signal of the new model's capability, and a vivid illustration of long-horizon memory and planning weaknesses.
More from Fun
- User's Muse 'privacy invasion' claim backfires: his own screenshot shows he granted Messages read access — giffmana · 2026-10-01
- Artist argues AI generators mash the creative process into latent space, losing what makes art — rms80 · 2026-10-01
- Tristan Buckmaster interviews on storm over denied claims that AI stole his Navier-Stokes work — burny_tech · 2026-10-01
- "DeepMind is kil" meme goes viral, researcher replies simply "no" — zacharynado · 2026-10-01
- AI community Rickroll parody mocks rate limits and model downgrades — thesaraharminta · 2026-10-01
- Indie Dev Ships a Halloween Kids' Adventure Game Built With Replit — jasonkneen · 2026-10-01