Ant Group open-sources AReno: single-node toolkit for LLM RL post-training and serving
pmttyji · reddit · 2026-08-18
Ant Group's ASystem team open-sourced AReno, a local LLM post-training toolkit covering RL, SFT/DPO-style training, serving, and agentic RL. Built on a self-contained, full-stack design, it takes you from a base checkpoint to a trained, served model on a single node — no cluster, and no wiring together a training framework, inference server, and kernel library.
Highlights: post-training methods are plug-and-play via the --algo flag or one Trainer class; the package is lightweight, depending mainly on PyTorch and FlashAttention; for agentic RL, agent functions run against a local OpenAI-compatible proxy, return explicit trajectories, and train from tokens, logprobs, rewards, and loss masks; algorithms, model adapters, reward functions, and hardware backends are all extensible. A tutorial trains Ling 3.0 Tiny to play tic-tac-toe on a DGX Spark.
More from coding & agent
- Agent coding tips: run /simplify, then fresh-context review of the diff — lucasmeijer · 2026-08-18
- Developer claims Go is miles ahead for AI coding agents — dosco · 2026-08-18
- Claude Code CLI cuts p99 CPU usage by 50% via GC tweak — dsp_ · 2026-08-18
- Enterprise AI fails on messy data and context, not on the model — Rajxai · 2026-08-18
- DeepTeam: Open-Source Framework for Red Teaming LLMs and AI Agents — tom_doerr · 2026-08-18
- Builder replaces value model with an LLM call, routes estimator outputs to the trainer — cephaloform · 2026-08-18