Reasoning Model Underperforms in Law Write-on Competitions
neuranna · x · 2026-08-20
A preregistered experiment entered a frontier reasoning model into annual "write-on" competitions of five top-30 law reviews. The AI scored significantly below the human average, placing below every successful candidate in four reviews and beating only one in the fifth.
More from Research
- Reflection on RL: Good for boundaries, bad for long-term goals — sethlazar · 2026-08-20
- Rebranding STS work as technical AI safety for funding climate — evijit · 2026-08-20
- PySR v2.0 Released: High-Performance Symbolic Regression for Discovering Math Laws — MilesCranmer · 2026-08-20
- Visualizing Two-Tower MLP: Core Architecture from RecSys to CLIP — ProfTomYeh · 2026-08-20
- YC Paper Club: Deep Dive into Data, Benchmarks, and Multilingual Models — Y Combinator · 2026-08-20
- LightOn releases mLateOn: SOTA multilingual retrieval with just 115M parameters — antoine_chaffin · 2026-08-20