Intern-S2-397B: Shanghai AI Lab's 397B-A17B scientific MoE lands day-0 in vLLM
vllm_project · x · 2026-09-14
Shanghai AI Laboratory released Intern-S2-397B, a multimodal MoE foundation model for long-horizon scientific research: 397B total / 17B active params across 512 experts on the Qwen3.5 hybrid linear/full-attention architecture, 262K context, and a built-in shared-weight MTP head for speculative decoding.
Key claims:
- Top-tier open-source general ability in knowledge, coding, and agents
- Strong on scientific benchmarks like Biology-Instructions and Mol-Instructions
- Leading open-source results on IMO-Proof and AdvancedMathBench, claimed at the level of top closed models such as Gemini 3.1 Pro
Deployment: day-0 vLLM support (vLLM ≥ 0.22.1). The official FP8 checkpoint runs on 8×H100/H200 with TP=8; BF16 needs 8×H200. Requires trust-remote-code (custom InternS1Tokenizer), DeepGEMM disabled, FlashInfer TRTLLM MoE backend on NVIDIA. Time-series inference is LMDeploy-only for now.
Related event: Shanghai AI Lab Releases Intern-S2-397B Multimodal Foundation Model(2 posts)→
More from Infra
- Clover-35B-A3B Quantized to 29.4 GB Runs at ~42 tok/s on a 64 GB Mac — viveky259 · 2026-10-31
- Liquid Agent brings fully local LFM3 agent to Linux with one-command install — JosephJacks_ · 2026-10-31
- A fully local office AI stack: MiniCPM, Qwen3, LFM2.5 and Whisper — HowDevelop · 2026-10-31
- a16z: GPU rental prices up 106% in 3 months while token prices fall 58% — a16z · 2026-10-31
- vLLM nightly adds PLE disk offload, with a telling [Qwen4Exp] tag on the PR — rmhubbert · 2026-10-31
- Solo AI studio: per-minute GPU rentals rendered a 328-frame Blender shot for ~$1 — r0ck3t23 · 2026-10-31