Harvard Releases Dataset of 6.12 Billion Real-World LLM Inference Requests

Harvard's MadSys lab, working with Chutes and FreeInference, released a full year of production LLM inference metadata covering 6.12 billion requests and about 91 million users, offering a rare open resource for studying real serving workloads.

2026-09-20 ~ 2026-09-22 · 3 related posts

• Harvard lab releases one year of LLM inference traces: 6.12B production requests across 9,174 models — airesearch12 · 2026-09-20
• One Year of LLM Inference Metadata Released: 6.12 Billion Requests for Serving Research — generativist · 2026-09-21
• Harvard open sources LLM inference traces: 6.12 billion requests from a year of production traffic — markjeffrey · 2026-09-22