Gemini 4 Argon missed #1 on Vending-Bench due to memory slip on test end date

infoxiao · x · 2026-10-01

Gemini 4 Argon is "quite insane actually" on Vending-Bench, according to lukaspet — it would likely have taken the #1 spot if not for a few key memory mistakes. It sometimes forgot the test's end date, closing its vending shop too early and missing months of sales.

Quoted by infoxiao with a "can you blame it??" — an early (unconfirmed) signal of the new model's capability, and a vivid illustration of long-horizon memory and planning weaknesses.

Original post →

More from Fun

Fun channel →