Google says Gemini 4 Neon tops vending-machine agent benchmark, priced at $3 per million tokens
Zealousideal_Pin3444 · reddit · 2026-11-19
Google claims Gemini 4 Neon ranks #1 at running a simulated vending-machine business, priced at $3 per million tokens. The poster argues the leaderboard that actually matters next is whether a model can sit on hold with your cable company — and that cost per task, not leaderboard position, is what changes what people build.
Related event: Google's Gemini 4 Neon Tops Vending-Bench 2 Agent Benchmark(2 posts)→
More from Models
- Resolve launches SRE-1, a 27B RL-trained model for root-causing production incidents — tianyin_xu · 2026-11-19
- Theo does a about-face: 'Gemini 4 Neon might actually be a good model' — vitaliychiley · 2026-11-19
- Artificial Analysis Launches AA-PersonalityBench: 30 Traits, 8 Indexes, 53 Models — ArtificialAnlys · 2026-11-19
- GPT-6.2 writes 40% shorter, less structured replies and admits uncertainty far less, finds Artificial Analysis — ArtificialAnlys · 2026-11-19
- DeepSeek 4.1-Flash slips into game roles easily while Nemotron models need heavy coaxing — rickasaurus · 2026-11-19
- Leaked "Claude Mythos 5.5" strings spotted on Anthropic's site ahead of possible launch — imjustnewatai · 2026-11-19