MIT and NVIDIA's QDA uses agents to auto-design LLM quantization recipes, beating top public ones by up to 2.2 points

omarsar0 · x · 2026-11-20

MIT and NVIDIA present QDA (Closed-Loop LLM Quantization Design with Agents), handing the post-training quantization recipe-design loop to an LLM agent.

Key ideas

Fast evaluation

Results

The library, evaluator and harness will be open-sourced; the authors call it a step toward personalized, accessible RSI.

Related event: MIT and NVIDIA Unveil QDA: Agents Automate LLM Quantization Design(2 posts)→

Original post →

More from Infra

Infra channel →