GPT-5.5 Fails Legal AI Test
rohasnagpal · reddit · 2026-07-08
A post claims that OpenAI's GPT-5.5 failed a legal AI test because it fabricated non-existent legal clauses. The test consists of 10 short questions designed to assess reasoning, accuracy, honest handling of missing information, and consistency in output structure within legal scenarios.
More from Models
- User catches model failing to parse 400-paper file, citing stale news sources instead — jungofthewon · 2026-10-27
- Odd eval result: Gemini 4.1 Flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Poster surprised that v4.1 flash gets more accurate when asked to control its CoT — dfrsrchtwts · 2026-10-27
- Dev claims Anthropic is baking 'sabotage' into model behavior for 'wrong' engineering — cephaloform · 2026-10-27
- Gemini fails at listing unread emails, tells user to search Gmail manually — gethackteam · 2026-10-27
- Meta's Muse Spark Open goes live on Applied Compute for async RL post-training — ypatil125 · 2026-10-27