Berkeley's QF3: off-policy flow RL with filtered Q-gradients trains humanoids from scratch

berkeley_ai · x · 2026-10-15

UC Berkeley researchers (led by ChungMinKim) introduce QF3: Fast Flow RL with Filtered Q-Gradients, an off-policy addition to their flow-policy RL series. The recipe: hill-climb on ∇Q, filter for stability, and flow-match the replay buffer. It is sample-efficient and works on humanoids from scratch, VLA fine-tuning, and even image models.

Related event: Berkeley Releases QF3: Filtered Q-Gradients for Flow-Based Robot RL(3 posts)→

Original post →

More from Embodied

Embodied channel →