Paper: Gavel reveals long-context failures in frontier LLMs
cocoweixu · x · 2026-08-28
Accepted to EMNLP 2026, the Gavel paper studies frontier LLMs on legal case summarization with inputs up to 500K tokens. Models struggle beyond 256K tokens and are more likely to omit key info than hallucinate. Even the best model, Gemini 2.5 Pro, scores only 50. The authors also built Gavel-Agent, an agentic, reference-free evaluator that reduces token usage by 36% using Qwen3.
More from Research
- Schmidt Sciences awards $10M to 19 AI humanities research teams — OdedRechavi · 2026-10-15
- Mistral and CERN partner to build a Large Physics Model trained on billions of simulated collisions — MistralAI · 2026-10-15
- Global Transport coupling lifts guided flow generation: ImageNet FID 2.06 to 1.91 — mmbronstein · 2026-10-15
- Your breathing gives you away: Wi-Fi signals can reveal your breath rhythm — TinfoilTricorn · 2026-10-15
- Beyond text correlation: attaching a geometry simulator to ground model reasoning — gerardsans · 2026-10-15
- Sequen CEO Zoe Weil: Ranking Models Should Optimize Purchases, Not Clicks — TWIML AI Podcast · 2026-10-15