Gemini Frequently Hallucinates During Code Comprehension
GlompSpark · reddit · 2026-07-17
While testing the coding analysis capabilities of Gemini Flash 3.5, a user found it continuously hallucinating while reading a 7k-line code file:
- First, it falsely claimed that a certain logic was inside the realm class
- Then it fabricated non-existent header files and functions
- Even after being reminded, it continued to generate plausible but incorrect explanations
- Finally, it even admitted it hadn't actually seen the relevant code and was just "pretending to understand"
The key point of the post is that this version of Gemini is highly unstable on tasks involving long code files and locating specific logic, resulting in an experience of continuous hallucination rather than a one-off mistake.
More from Models
- OpenAI rated Astra 'Critical' for cyber capabilities — and admits it's harder to monitor — theguywhobuilds · 2026-09-11
- TestingCatalog's Daily AI Brief adds email editions, dishing Meta Muse and GPT-Live-1 rumors — testingcatalog · 2026-09-11
- ChatGPT monthly active users top 1.06 billion in August, fourth straight record month — FinanceYF5 · 2026-09-11
- PuzzleMask: Plain-Prose Attack Bypasses All 4 Tested LLM Gatekeepers at 100% — TechNadu · 2026-09-11
- OpenAI Codex may issue another usage reset this weekend, says Codex lead resets happen — umesh_ai · 2026-09-11
- OpenAI Reportedly Pointing Its Navier–Stokes Model at Riemann and P vs NP — 141_1337 · 2026-09-11