Harvey Open-Sources 100M+ Token Synthetic Law Firm Dataset for Agent Evaluation
HazyResearch · x · 2026-08-08
Legal AI company Harvey, in collaboration with EngramLab, has open-sourced a synthetic law firm dataset containing over 100 million tokens.
The dataset simulates work products from 250+ legal matters across 46 clients, spanning approximately 10,000 files. It serves as an evaluation environment to test AI agents' ability to search and understand a firm's past practice to inform present work, mimicking the institutional knowledge of a tenured associate or partner.
More from Research
- Zero-Model Screen Compilation: 86x Agent Memory Compression at 98% Accuracy — Nossa Iyamu · 2026-08-08
- UMD Releases Syllabus for 'Generative AI Agents' Course — furongh · 2026-08-08
- DeepOrg Benchmark: Evaluating Agents in Complex Enterprise Environments — dosco · 2026-08-08
- UCLA Study Reveals Genetic Signatures of Memory Encoding in the Human Hippocampus — anne_churchland · 2026-08-08
- Ludic: An Open-Source LLM RL Library Designed for Agentic Behavior — willccbb · 2026-08-08
- TutorMoments: Do AI tutors know when to help and when to hold back? — Hugging Face Blog · 2026-08-08