NVIDIA and PrimeIntellect post-train Nemotron 3.5 Super VL, boosting AutomationBench-AA by ~70%
willcb · x · 2026-10-16
PrimeIntellect collaborated with NVIDIA to post-train Nemotron 3.5 Super VL on thousands of tasks reflecting real enterprise workflows in sales, operations, marketing, and finance. The effort improved the model's AutomationBench-AA score by roughly 70% on the public split. Collaborators call AutomationBench a strong testbed for evaluating agents on complex real-world enterprise workflows, with much more to build.
More from Models
- NVIDIA releases Qwen3.8-Flash-Next FP4 local model with new lossless compression format — TheZachMueller · 2026-10-16
- Are the fastest GPU kernels now written by AI? Kernels are hyper-verifiable, argues one dev — fleetwood___ · 2026-10-16
- Scale AI launches muse spark open: 816B-param MoE with 1M context, billed as top US open-weight model — jiayi_pirate · 2026-10-16
- NVIDIA HF listing for Qwen3.8-Flash-Next-FP4-Local leaks unannounced Qwen3.8 model — TheZachMueller · 2026-10-16
- Muse Spark Open, billed as the most capable US open-weight model, lands on Nebius day one — Arindam_1729 · 2026-10-16
- Model at capacity for a straight week drives frustrated dev back to Opus — joonasvirtanen · 2026-10-16