Hikers trapped after following Gemini's route advice, days before OpenAI's AGI claim
Dapper-Tale-4021 · reddit · 2026-09-08
A consultant contrasts two events: three California hikers used Gemini to plan a Mount Shasta route, were advised to carry far less water and food than needed, summited four hours late, descended in the dark, injured a knee, and spent a night trapped until rescued. Google could not reproduce the bad advice.
Two days later, OpenAI launched GPT-6 Astra and declared the AGI era; independent evaluators remain cautious, ranking Anthropic's Fable 5.1 higher overall.
The author's point: as models get more capable, people use them in higher-stakes situations, but knowing when to trust them doesn't improve—in fact it worsens as answers sound more convincing. In his AI adoption consulting, the top problem isn't distrust but not knowing when to stop trusting.
Related event: Climbers Stranded After Following Gemini's Advice(2 posts)→
More from AGI Musings
- Economist Bharat Chandar named Research Director for AI Economics at Stanford Digital Economy Lab — RishiBommasani · 2026-10-27
- Pangram AI detector backlash: critics' false claims born of deeper fear of AI writing — gleech · 2026-10-27
- Aeon's former EVP: AI agents are the most impactful innovation of my lifetime — akumar · 2026-10-27
- Physicists Let AI Pick Its Own Problem—It Wrote a Publishable Paper in 2 Hours — burny_tech · 2026-10-27
- Deep learning veteran warns: don't let entrenched disbelief derail prep for the next big tech — jachiam0 · 2026-10-27
- Should platforms serve third-party AI agents? The antitrust question — sjgadler · 2026-10-27