Harvard open sources LLM inference traces: 6.12 billion requests from a year of production traffic
markjeffrey · x · 2026-09-22
Harvard, in collaboration with Chutes (an open inference network on Bittensor averaging 27B tokens/day), released a paper studying a full year of production LLM traffic: 6.12 billion requests of inference metadata traces, fully open sourced. The dataset supports research on real-world LLM serving workload understanding, system design, and infrastructure optimization.
Related event: Harvard Releases Dataset of 6.12 Billion Real-World LLM Inference Requests(3 posts)→
More from Research
- Is synthetic-cell SpudCell the enabling tech for mirror life? Researchers weigh in — NikoMcCarty · 2026-09-22
- Aethos X hits 94% on EnterpriseRAG-Bench at 42k files, nearing effective ceiling — rohanpaul_ai · 2026-09-22
- Meta's LION uses sparse key-value memory to fix preference drift in generative recsys — armand_ruiz · 2026-09-22
- AMD Engineers Publish GEMM Optimization Tutorial Blog Inspired by the GEMM Ladder — simran_s_arora · 2026-09-22
- Stop Trusting MMLU-Pro: Every's Evals Lead Says Build Your Own AI Benchmark — danshipper · 2026-09-22
- DL models now learn from less data; new ensemble framework boosts pharma ELN prediction robustness — marwinsegler · 2026-09-22