4 coding agents on one RTX 3090: custom CUDA engine hits ~290 tok/s with Qwen3.8-27B
Adorable_Weakness_39 · reddit · 2026-10-27
A custom CUDA engine runs Qwen3.8-27B on a single RTX 3090 serving four coding agents simultaneously at 290 tok/s total — 3-4x the throughput of llama-server --parallel. Video demo included.
Related event: Single RTX 3090 runs 4 coding agents at ~290 tok/s with custom CUDA engine(2 posts)→
More from coding & agent
- Hyphenate raises $45M Series A as revenue grows 86x with autonomous finance agents — aakashgupta · 2026-10-27
- t3code vs latest Codex: dev says one feature — Astras spinning up Opus armies — wins — ludwigABAP · 2026-10-27
- OpenAI, Google, Anthropic Reportedly Building FINRA-Style AI Self-Regulator by 2027 — emmanuelvivier · 2026-10-27
- IBM Launches Verifiable Identity and Control for Enterprise AI Agents — emmanuelvivier · 2026-10-27
- One word in your prompt decides the language: 'easy' gets Python, 'fast' gets Rust — rseroter · 2026-10-27
- NewMax runs optimized Claude Code with BYOK keys, plus pool rotation and OAuth — yangyi · 2026-10-27