Flow Reasoning Models hit ~100% solve rates on hard structured reasoning benchmarks
burny_tech · x · 2026-09-12
A thread collecting concurrent work on structured reasoning: Flow Reasoning Models (FRMs) and Diffusion as a Training Curriculum for Timestep-Free Iterative Reasoning.
FRM (arXiv:2606.29150) key ideas:
- Existing architectures struggle: autoregressive models commit sequentially and can't revise earlier decisions; masked diffusion models need careful decoding schemes for interdependent predictions.
- FRMs adapt continuous flows over discrete structured outputs, using self-conditioning on past outputs to turn one-shot denoising into iterative solution refinement — making and revising decisions in parallel.
- To fix exposure bias at greater recurrent depth, they propose Fixed-Point Forcing (FPF), training on states produced by the model's own inference dynamics while keeping the standard flow-matching objective.
- Results: 99.5%, 100.0%, and 99.9% solve rates on Sudoku-Extreme, Zebra, and Maze-Unique, with higher peak accuracy on Sudoku-Extreme than evaluated masked-diffusion and sparse methods.
The author sees substantial utility in these approaches and is excited about their development.
More from Research
- Heads Of Security: paper pinpoints and rewires attention heads behind prompt injections — jonasgeiping · 2026-10-31
- BATv1: 17,145 Cherimoya models map TF binding across 3,429 ENCODE ChIP-seq experiments — jmschreiber91 · 2026-10-31
- UCLA's ChairNav teaches autonomous wheelchairs to learn each rider's preferences — zhoubolei · 2026-10-31
- How much compute should data rewriting get? New scaling-law study quantifies it — ChengleiSi · 2026-10-31
- Open-source sticker library covers all 11,064 living bird species, drawn by AI — AlchainHust · 2026-10-31
- Epoch AI: AI chip compute grows 2.5x a year, down from 6x in 2023 — rohanpaul_ai · 2026-10-31