UnMaskFork: Test-Time Scaling for Masked Diffusion Models
SakanaAILabs · x · 2026-07-04
Sakana AI introduced UnMaskFork, a test-time scaling framework for Masked Diffusion Language Models (MMDLM), which will be presented at ICML 2026.
Leveraging Monte Carlo Tree Search (MCTS), the method dynamically switches between multiple pretrained MDLMs for collaborative text generation, exploring diverse generation paths. It consistently outperforms standard Best-of-N and other tree search baselines on coding and mathematical reasoning tasks.
More from Research
- Researcher flags unresolved data transparency issues in compositionality evals — najoungkim · 2026-10-27
- Separate Forms from Estimators: Why Steer by Difference of Means When You Can Use SGD? — johnhewtt · 2026-10-27
- EMNLP paper probes why some LLM biases survive rewording while others don't — radamihalcea · 2026-10-27
- Datology webinar: Curation Studio matched top data baselines with under 20% compute — josh_wills · 2026-10-27
- KANLab: an interactive browser playground for Kolmogorov-Arnold Networks — Lukas Niehaus · 2026-10-27
- CMU's LLM2Cert synthesizes stability certificates verified via SMT and Lean — CarnegieMellonU · 2026-10-27