Training Agent Organizations from Nemotron-Super-120B: Avalon-M1-Mini Works

rosstaylor90 · x · 2026-10-23

Avalon asked whether 'agent organizations' can be trained with a simple approach. Starting from a Nemotron-Super-120B-A12 base with minimal SFT, then applying their RLCR recipe, Avalon-M1-Mini performs well—e.g. versus NVIDIA's non-OPD model trained on the same base.

They acknowledge an RLVR baseline on the same environments is still needed (compute-limited, likely next), and note OPD models are stronger at this scale, but the interest is RLCR as a from-scratch recipe without a strong teacher.

On safety: in scenarios like a (heavily simulated) collective cyberattack, whistleblowing, and human loss-of-control, refusal to participate in bad actions remains consistent—whether collective objectives bias agents toward the collective over humans is still being studied.

Related event: Avalon Shows Agent Organizations Complete Tasks 4x Faster at Same Token Budget(3 posts)→

Original post →

More from coding & agent

coding & agent channel →