IQuest-Q1 open-sourced: 320B MoE with 15B active, 524K context, day-0 vLLM support
vllm_project · x · 2026-09-29
IQuest Research released and open-sourced IQuest-Q1: a 320B-parameter MoE model (15B active per token, 8 of 256 experts live) with 524,288-token context, built for code, software engineering, and complex agentic tasks. Weights, technical report, HuggingFace and GitHub are all live.
vLLM ships day-0 support using only existing pieces: a hybrid KV cache coordinator for the 3-sliding-to-1-full attention mix (only 25 of 88 layers grow cache with context), a sinks path in attention backends for sink attention, and EAGLE speculative decoding with probabilistic draft sampling for the recursive MTP head.
Related event: IQuest Open-Sources IQuest-Q1, a 320B MoE Model for Agentic Coding(11 posts)→
More from coding & agent
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- ffmpeg-skill gives coding agents local video editing via 42 FFmpeg tools and MCP — kajisho5 · 2026-11-16
- Every's Frontier team on Claude Fable 5.2: overnight agent jobs, cost tradeoffs, real builds — every · 2026-11-16
- Agents Now Reply to Slack Messages on Their Own, Resolving a Prod Incident Ghost-to-Ghost — iamrobotbear · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- DeepSeek open-sources its app frontend "chat-demo", already at 3.9k stars — NielsRogge · 2026-11-16