Shanghai AI Lab's Sage S2.1 Flash tops 4 of 15 agentic benchmarks
jacek2023 · reddit · 2026-11-16
Shanghai AI Laboratory released Sage S2.1 Flash on Hugging Face, a scientific multimodal model built for research tasks requiring multi-round analysis and verification. It combines scientific data understanding with retrieval, coding, and tool use — running specialized software, checking intermediate outputs and visual feedback, and adjusting next steps accordingly.
Across 15 benchmarks against 6 models, it ranked first on 4 and second on 7:
- ML engineering: #1 on MLE-bench Lite with 90.3, beating DeepSeek-V4.1-Flash-1017 (89.2)
- Office/professional documents: #1 on OfficeQA Pro (72.2), Harvey LAB (25.0), and SpreadsheetBench 2 (37.1)
- Tool use & research execution: #2 on AutomationBench, ALE-CLI, BFCL V4, WebArena-Verified, DeepResearch Bench II, JobBench, and OSWorld-Verified
- Compared against GLM-5.3-Flash, DeepSeek-V4.1-Flash-1017, Qwen3.8-Max, GPT-5.6 Sol, and Claude Opus 5
Related event: Shanghai AI Lab Open-Sources Science Multimodal Model Sage S2.1 Flash(3 posts)→
More from Models
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- Stealth Anthropic model spotted in Devin build as METR chart shows frontier pace up 1.4x — daniel_mac8 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- Unsloth Q8 crushes default Q3 in a self-hosted test over 331 financial PDFs — No_Cartographer3953 · 2026-11-16
- METR time-horizon chart updated: doubling every 1.7 months since Opus 4.5, 'Model 4' ~38h — ben_j_todd · 2026-11-16