HDM paper: "zero-or-T" routing cuts agentic token cost by 80% with no accuracy loss

pmttyji · reddit · 2026-11-16

A new paper introduces a zero-or-T thinking paradigm realized as a Hybrid Decision Model (HDM): instead of tuning how much a model reasons, a single frozen backbone either answers from implicit thinking in one forward pass (generating no tokens) or pays T tokens for full autoregressive reasoning when it's worth it.

How it works

Results

Paper, code and HDM blocks are open-sourced on arXiv, GitHub and Hugging Face.

Original post →

More from Research

Research channel →