Hikers trapped after following Gemini's route advice, days before OpenAI's AGI claim
Dapper-Tale-4021 · reddit · 2026-09-08
A consultant contrasts two events: three California hikers used Gemini to plan a Mount Shasta route, were advised to carry far less water and food than needed, summited four hours late, descended in the dark, injured a knee, and spent a night trapped until rescued. Google could not reproduce the bad advice.
Two days later, OpenAI launched GPT-6 Astra and declared the AGI era; independent evaluators remain cautious, ranking Anthropic's Fable 5.1 higher overall.
The author's point: as models get more capable, people use them in higher-stakes situations, but knowing when to trust them doesn't improve—in fact it worsens as answers sound more convincing. In his AI adoption consulting, the top problem isn't distrust but not knowing when to stop trusting.
Related event: Climbers Stranded After Following Gemini's Advice(2 posts)→
More from AGI Musings
- mark_k: "Eject all doomers from the AI companies — they're destroying you from the inside" — mark_k · 2026-09-11
- Adam Marblestone's Podcast Reading List: Evolution of Intelligence to Digital Minds — KordingLab · 2026-09-11
- Superintelligence will be maximum good, not stupid or evil, argues Patterson — davidpattersonx · 2026-09-11
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Should AI models be taught morality? Breakout incidents expose missing ethical training — Pfungus_ · 2026-09-11
- SoftBank's Masayoshi Son predicts 100 trillion self-replicating AIs: "humans' era as top life form is ending" — Puzzleheaded-King584 · 2026-09-11