Gemini 4 Neon flunks Runescape Bench: ambitious strategies, terrible time management
morgymcg · x · 2026-11-20
maxbittker notes that Gemini 4 Neon does terribly on Runescape Bench because it picks super-ambitious strategies but has terrible time management, never finishing them before the buzzer. @morgymcg replies "Neon is me." Using a classic MMO as an agentic benchmark is itself amusing, and the model's overreach-then-fail pattern is telling.
More from Fun
- Fan makes an AI video showing how much ~30B Qwen models improved in 28 months — vanstriendaniel · 2026-11-20
- moyix on LLMs' worst writing habit: "disclaiming things no one ever claimed" — moyix · 2026-11-20
- Day 4 of an AI agent run: "Whoever is in charge of mornings is doing well" — generativist · 2026-11-20
- One share filled: Anthropic IPO retail allocations are hilariously tiny — felpix_ · 2026-11-20
- GTA VI Is Out Before ICLR Reviewers Even Acknowledged Rebuttals — aran_nayebi · 2026-11-20
- Open-source orion-gaze-live predicts where you're looking from screen and input — no webcam needed — round · 2026-11-20