Qwen3.8-27B Serving Configs: DGX Spark vLLM and RTX 4090 llama.cpp
erdaltoprak · reddit · 2026-08-15
Reddit user erdaltoprak shares serving configurations for Qwen3.8-27B: one for Nvidia DGX Spark with vLLM (NVFP4, 262k context, MTP speculative decoding), and one for RTX 4090 with llama.cpp (GGUF Q4KM, 131k context, flash attention). Docker Compose files provided.
Related event: Community Shares Qwen3.8-27B Deployment on 32GB VRAM(4 posts)→
More from coding & agent
- atuin v18.24 adds cross-device sync to resume AI threads across Claude and Codex — braelyn_ai · 2026-10-16
- Agents turn conservative as context grows: edits shrink from 150 to 30 lines — dbreunig · 2026-10-16
- ai& becomes an official built-in Cline provider with 13 open-weight models — DavidBennett__ · 2026-10-16
- Open-source rizin-mcp lets LLMs run local binary and malware analysis via Rizin — Pure_Emergency1424 · 2026-10-16
- x402 as a free GTM channel: agents discover 100+ tools, no API keys needed — 0xJeff · 2026-10-16
- Sam Altman: stop getting better at prompts, build loops and graphs that prompt for you — goyalshaliniuk · 2026-10-16