LLMs citing fake laws force companies to cave to complaints
RexDouglass · x · 2026-08-31
A fintech worker reports a rise in customers using LLMs like Gemini to write angry letters citing laws to companies. The issue is that LLMs often cite regulations from other jurisdictions that don't apply, yet companies feel obligated to respond and often settle.
More from AGI Musings
- Why human analogies for AI are wrong — vishalmisra · 2026-08-31
- AnjneyMidha: The unprecedented speed and scale of ML systems is wildly interesting — deanwball · 2026-08-31
- Kids hiding candy is textbook reward hacking, and parenting proves why alignment is hard — yunta_tsai · 2026-08-31
- Poll: 75% of Americans Oppose Local Data Centers — AndyMasley · 2026-08-31
- Gary Marcus and others slam Dwarkesh's viral "AI civilizations" telling of the OpenAI incident — Gary Marcus · 2026-08-31
- Zvi's Postmortem Deep-Dive: The HuggingFace Hack Isn't Just OpenAI's Problem — Anthropic Too — Don't Worry About the Vase (Zvi) · 2026-08-31