BYOD converts autoregressive LMs to diffusion models with cheap LoRA adapters

UMCUtrecht · hf · 2026-11-03

BYOD (Build Your Own DLM) from UMC Utrecht converts autoregressive language models into diffusion language models via parameter-efficient LoRA adapters, enabling parallel generation at minimal training cost while preserving base-model knowledge. A demo visualizes the 64-step denoising process unmasking tokens, offering teams a low-cost path to diffusion-style parallel generation.

Original post →

More from Research

Research channel →