Hazy Research's open-source NCM generates text 31x faster via coarse-to-fine concept modeling

simran_s_arora · x · 2026-10-20

Hazy Research released Next-Concept Modeling (NCM), fully open source: a multiscale residual VQ-VAE compresses text into hierarchical discrete concepts, and a transformer predicts the hierarchy coarse-to-fine with all positions parallel — fixed 12 forward passes regardless of length. It's 10–31x faster than diffusion text models, needs 3–5x fewer training tokens, and solves hard Sudoku at 86.1% in 12 parallel steps, beating autoregressive and diffusion baselines. The reposter ran both demos on CPU in seconds.

Original post →

More from Models

Models channel →