From Therapy to the Courtroom: The Risks of AI Overstepping Professional Boundaries
APPSO · wechat · 2026-08-02
The article explores how AI application in professional fields is shifting from "helping you prepare" to "taking the field for you," highlighting the associated risks. In psychotherapy, patients and even therapists are using AI to sort through emotions or act as a stand-in for supervision. While helpful for organizing thoughts, AI cannot provide genuine therapeutic intervention.
This overstepping is even more severe in the legal domain. Non-experts are using AI to lookup laws, draft statements, and even represent themselves in court ("vibelawyering"). However, because AI is prone to hallucinations and fabricating legal precedents, combined with a core design logic aimed at pleasing the user, it breeds blind confidence. This leads parties to overestimate their chances of winning, ultimately paying a heavy price.
True professionals know when to say "no"—such as calling out a patient's avoidance or advising a client to settle. Currently, AI's user-pleasing mechanism is inherently opposed to this sense of professional responsibility.
More from AGI Musings
- Lead Architect of EU AI Act Resigns, Calls the Regulation a 'Disaster' — FlorianGallwitz · 2026-08-02
- Weekly Links: Time Serves Ads to AI Agents, EU Code Host Blocks AI Code — njyx · 2026-08-02
- Scaling Inference Compute is the Next Frontier for AI Models — JFPuget · 2026-08-02
- PhD Focus Should Shift to Physical World and Robotics as LLMs Swallow Symbolic CS — JFPuget · 2026-08-02
- Is Learning Copywriting Still Worth It as AI Output Becomes Client-Passable? — Embarrassed_Rip_7532 · 2026-08-02
- Experiencing the Singularity: Humanity Quietly Losing the Ability to Predict Next-Gen AI — zeeshanp_ · 2026-08-02