ByteDance-backed team open-sources Axion1.0: two-stage SFT+RL agent training beats GPT-6 on HLE
机器之心 · wechat · 2026-11-17
A team from Duke, ByteDance, UMD and University at Buffalo released Axion1.0, an agent foundation model trained with a minimal pipeline of just two SFT stages plus RL — no mid-training, DPO, or online policy distillation — and open-sourced the full data construction, training code, data and models.
Pipeline
- Stage 1 SFT: difficulty-augmented science problems (answers turned into intermediate quantities, expanded ranges), 10.8k multi-step reasoning traces with Python only;
- Stage 2 SFT: programmatic question generation from structured databases forcing tool use (search, web, Python), 7.5k verified tool-interaction traces;
- RL: asynchronous GRPO with a staged reward — verified intermediate progress earns partial reward, with later steps gated on earlier checks passing.
Results
- Axion1.0-122B scores 59.0% on the restricted full Humanity's Last Exam, above GPT-6 Astra (57.2%);
- 66.7% on FrontierScienceResearch, beating GPT-5.6 Sol;
- 87.0% on FrontierScienceOlympiad, above Gemini 3.1 Pro;
- 35B hits 62.2% on SEAL-0, leading all listed comparisons.
The method also works on small models (4B/9B reach 53.1%/63.1% on HLE-130 with SFT only) and closes a 9.2-point base-model gap to 0.8 points, showing the data recipe transfers across Qwen bases.
More from coding & agent
- Ought launches Epistemics Fund: $500k–$5M grants for fact-checking and forecasting tools — NathanpmYoung · 2026-11-17
- Building Agent-im: A Four-Layer Model for Agent Versioning, Memory and Secrets — yangyi · 2026-11-17
- Peter Steinberger says "local isn't the future" as he urges devs to move to cloud agents — steipete · 2026-11-17
- Tiny Shenzhen: a 17M-person city rendered in your browser, open source — vincent_koc · 2026-11-17
- Cloudflare open-sources Kitesurf, a Chromium-free browser engine for AI agents — shoumikgoswami · 2026-11-17
- Pass the remaining deadline budget to each agent step instead of fresh timeouts — arpit_bhayani · 2026-11-17