Qwen3.8-27B matches top closed-source models on benchmarks while running on a single consumer GPU
Artificial Analysis' latest benchmarks show that Alibaba's open-weights Qwen3.8-27B scores 52 on the intelligence index, on par with top closed-source models such as DeepSeek V4 and GPT-5.6 Luna Max, while being runnable locally on a single RTX 3090-class consumer GPU ($2,000-3,000). The community hails this as a 'DeepSeek moment' for local AI and a major milestone for open-source models.
Confirmed
- Artificial Analysis composite benchmark: Qwen3.8-27B scores 52, comparable to DeepSeek V4 and GPT-5.6 Luna Max, beating all models from four months ago (including Opus); hardware cost $2,000-3,000
- On the Agentic Index (max reasoning settings), Qwen3.8 Max ties GPT-5.6-Sol at 58 for first place; Qwen3.8 27B scores 51, overtaking GPT-5.6-Terra, GLM 5.2 and DeepSeek V4 Pro 0813
- Score jumped from 38 in the previous version to 52; the MoE Qwen 3.6 35B A3B scores 32, slightly below the 27B dense model
- haider1 notes the model is open-weights and its index score of 52 essentially matches GPT-5.6 Luna at max reasoning; udmrzn adds it can run locally on laptops or even in browsers via a custom WebGPU kernel
- Local tests: remilouf reports 63 tokens/s on Mac Studio; appenz ran complex agentic tasks on a MacBook and saw it beat DeepSeek V4 and Opus 4.7 (roughly 50x larger) on one benchmark
- WonderRico's local agent-coding benchmark: Medium mode scores above the 3.6 version with far better efficiency (nearly half the requests, one-third fewer generated tokens), reaching DeepSeek v4 Flash 310 level
- Charts by MikePFrank and enruben plotting Artificial Analysis scores vs. parameter count show the 27B model as a striking outlier; Hesamation places the Qwen 70B-class model at the far left of the size-intelligence Pareto frontier
- pstAsiatech reports parity with GPT-5.6 Luna and results close to DeepSeek and Zhipu models; users like yacineMTB and ArnoStride call it 'shockingly good' for its size
Unconfirmed
- A Twitter user relayed by AccBalanced claims the circulating story is actually old news about Qwen 2.5 27B beating SOTA models from six months ago (GPT-4.5, Gemini 2.5 Pro, Claude 4 Opus) with garbled model names/versions; this does not align well with the 08-17/08-18 Artificial Analysis data posts and remains unverified
Why it matters
- Users (anderspitman, yaboyyoungairvent) argue that frontier-class capability on $2,000-3,000 hardware dramatically lowers the barrier to top-tier AI; community discussions frame it as a 'DeepSeek moment' for local models
- EAccelerate42 notes its metrics rival trillion-parameter-class models like GLM5.2 (800B) and DeepSeek v4 pro (1.6T); Scobleizer declares the local AI era has arrived
- Multiple scatter plots confirm the model deviates sharply from the historical size-intelligence trend, sparking debate on architecture and MoE efficiency
2026-08-17 ~ 2026-08-19 · 20 related posts
- Episode 1: Qwen 3.8 27B "Overthinking" Debate: Tests Point to Necessary Cost for Performance(2026-08-17, 7 posts)
- Episode 2: Qwen3.8-27B matches top closed-source models on benchmarks while running on a single consumer GPU(2026-08-17, 20 posts)
- Episode 3: Qwen 3.8 Default Temperature Causes Gibberish, Lower It(2026-08-18, 2 posts)
Primary sources
- Qwen3.8-27B runs at 63 tok/s on Mac Studio — remilouf · 2026-08-17
- [source] Qwen3.8-27B Benchmarks Show It Neck and Neck with DeepSeek V4 and GPT-5.6 Luna Max — anderspitman · 2026-08-18
- Qwen3.8-27B rivals frontier models, runs on a single RTX 3090 — yaboyyoungairvent · 2026-08-18
- Qwen 3.8 27B sees massive score jump; MoE efficiency gains discussed — Gear5th · 2026-08-18
- [source] Qwen3.8 27B outscores GPT-5.6-Terra on Artificial Analysis Agentic Index — UnknownEssence · 2026-08-18
- Qwen3.8-27B hits 52 on Artificial Analysis — inductionheads · 2026-08-18
- 27B Qwen3.8 rivals 1.6T parameter models in performance — EAccelerate_42 · 2026-08-18
- Qwen3.8 27B outperforms larger models on local MacBooks — appenz · 2026-08-18
- Qwen 3.8 27B Scores 52, Matching Top Models Locally — Scobleizer · 2026-08-18
- Benchmark: Qwen 3.8 27B in local agentic coding tasks — WonderRico · 2026-08-18
- [source] Qwen-3.8 27B scores 52 on intelligence index, rivaling GPT-5.6 Luna — haider1 · 2026-08-18
- Qwen 27B ranks above半年前 SOTA models, runs on laptop — AccBalanced · 2026-08-18
- Qwen 3.8 27B beats DeepSeek V4 on Agentic Index, runs on $2-3k hardware — LeviTurk · 2026-08-18
- Alibaba's lightweight Qwen matches GPT-5.6 Luna in benchmarks — pstAsiatech · 2026-08-18
- Qwen3.8-27B scores 52, matches GPT-5.6 Luna and runs locally — udmrzn · 2026-08-19
- Qwen 72B model breaks the size-intelligence curve, resetting consumer hardware expectations — Hesamation · 2026-08-19
- Chart reveals Qwen 3.8 as a massive performance outlier for its size — MikePFrank · 2026-08-19
- Chart Shows Qwen 27B Outperforming Peers, Defying Size-to-Performance Norms — enrub_en · 2026-08-19
- New Qwen model shockingly good for its size — yacineMTB · 2026-08-19
1 near-duplicate retellings: ArnoStride