Apple Proposes DACA-GRPO: Denoising-Aware Credit Assignment for Diffusion LLM RL

Apple ML Research · rss · 2026-09-16

Apple ML Research introduces DACA-GRPO (Denoising-Aware Credit Assignment for GRPO), targeting two fundamental weaknesses of RL for diffusion LLMs:

Problem: existing methods treat all denoising steps as equally important, lacking temporal credit assignment across the denoising trajectory, and rely on biased, high-variance mean-field likelihood estimates
Solution: DACA-GRPO is a lightweight, plug-and-play enhancement for any GRPO-style trainer, adding denoising-aware credit assignment

A method-level advance for RL fine-tuning of diffusion language models.

More from Research