Modal trains RL on mixed-precision, mixed-accelerator samplers at lower cost

Modal Blog · rss · 2026-10-13

Modal trained a model on agentic coding tasks using fully asynchronous RL with mixed-precision, mixed-accelerator samplers. With off-policy correction, training stayed stable through convergence, matching homogeneous samplers at lower cost — a viable path to reusing heterogeneous hardware for RL rollouts.

Original post →

More from Infra

Infra channel →