One Year of LLM Inference Metadata Released: 6.12 Billion Requests for Serving Research
generativist · x · 2026-09-21
Research group 1a1a11a announced the release of one year of LLM inference metadata traces covering 6.12 billion requests, built by grad student William Nixon in collaboration with Jon Durbin and Chutes AI. The dataset targets real-world LLM serving workload understanding, system design, and infrastructure optimization.
Related event: Harvard Releases Dataset of 6.12 Billion Real-World LLM Inference Requests(3 posts)→
More from Infra
- Cloudflare Talk: Swapping Some Agent LLM Calls for Fast Models Like Jev Gives Big Speedups — michellechen · 2026-11-12
- Cloudflare Trains Its Own Clef and Clairic Models to Complete Its Agent Stack — michellechen · 2026-11-12
- AWS open-sources 23 production-ready GenAI assets, cutting build time from months to weeks — AWS ML Blog · 2026-11-12
- Sixth Street CEO: ~$200B of Chips Sitting in Warehouses as Data Centers Lag Behind — SumitGup · 2026-11-12
- AWS CEO Matt Garman: Space Data Centers Are 10-20 Years Away, Likely Not Economically Feasible — rohanpaul_ai · 2026-11-12
- CoreWeave Database Goes GA: Managed PostgreSQL Running Inside Your CKS Cluster Next to GPUs — _ScottCondron · 2026-11-12