Gemini 4 Scores 3.95 in Blind Coding Audit, Developers Report Heavy Hallucinations
A blind audit by theo scored Gemini 4 (Argon) 3.95 with 51% of its claims judged false, while developer gnukeith reported the model hallucinates heavily on real codebases, making it unusable for actual coding work.
2026-10-15 ~ 2026-10-15 · 2 related posts
- Episode 1: Google Unveils Gemini 4 Argón with Focus on Deep Reasoning(2026-10-07, 2 posts)
- Episode 2: Gemini 4 Argon's Delayed Rollout Fuels Speculation of Weekend Release(2026-10-07, 4 posts)
- Episode 3: Gemini 4 Codenamed Argon Leaks Across Google Platforms Ahead of Launch(2026-10-09, 10 posts)
- Episode 4: 'Gemini 4 Argon' Hype Sweeps Reddit, But It's All a Joke(2026-10-10, 3 posts)
- Episode 5: Google reportedly tests Gemini 4 "Carbon" internally, coding nears Opus 5.5(2026-10-10, 19 posts)
- Episode 6: Gemini 4 "Argon" rumors surge as model option surfaces in Antigravity IDE(2026-10-11, 6 posts)
- Episode 7: Gemini 4 Argon Leaks Across Google Surfaces as Launch Nears(2026-10-12, 20 posts)
- Episode 8: Leaked promo images and screenshots fuel Gemini 4 Argon rumors(2026-10-13, 7 posts)
- Episode 9: Google launches Gemini 4 Argon across API, apps and search(2026-10-13, 192 posts)
- Episode 10: Gemini 4 Argon Wins Over Reviewers, But Subscription Limits Spark Backlash(2026-10-14, 60 posts)
- Episode 11: Gemini 4 Argon Early Tests: Developers Showcase Million-Token Outputs(2026-10-14, 7 posts)
- Episode 12: Gemini 4 Argon Launches, Refactoring 6M Lines of Chrome Code in Weeks(2026-10-14, 9 posts)
- Episode 13: Gemini 4 Argon Sweeps Leaderboards Post-Launch, Cost Debate Persists(2026-10-14, 7 posts)
- Episode 14: Google Launches Gemini 4 Argon with 217-Page Safety Report and Fusion Math Breakthrough(2026-10-14, 46 posts)
- Episode 15: Google's Gemini 4 Argon Accelerates Quantum Computing and Protein Design Research(2026-10-14, 3 posts)
- Episode 16: Gemini 4 Argon Generates Playable 3D Games in One Prompt(2026-10-14, 2 posts)
- Episode 17: Gemini 4 Argon Arrives on GitHub Copilot(2026-10-14, 2 posts)
- Episode 18: Leaked Gemini 4 Argon safety evals show top-tier cyber offense and stealth beyond human baselines(2026-10-14, 10 posts)
- Episode 19: Neel Nanda: Gemini 4 Argon markedly harder to monitor(2026-10-14, 2 posts)
- Episode 20: Gemini 4 Scores 3.95 in Blind Coding Audit, Developers Report Heavy Hallucinations(2026-10-15, 2 posts)
- T3 Code blind audit: Gemini 4 Argon scores 3.95 with 51% false claims, Opus 5.5 tops at 8.40 — theo · 2026-10-15
- Dev says Gemini 4 is 'outright unusable' for real code work due to hallucinations — gnukeith · 2026-10-15