RTX 3080 20GB gets ReBAR + P2P unlock, boosting prompt processing up to 115%
No-Refrigerator-1672 · reddit · 2026-10-26
- A modded RTX 3080 20GB finally got ReBAR and P2P support (work by u/nathannguyennng), yielding 70%–115% faster prompt processing in tensor parallel mode.
- Tested on dual RTX 3080 20GB (240W-limited) with Threadripper, running vLLM 0.32.0 on Swift-1.5-Qwen3.8-27B-AWQ-INT4 with MTP and FP8 KV cache.
- At 8192-token prompts, prefill jumped from 967 to 2080 tok/s (+115%); gpu-unlock alone adds 21%–29%. Decode ITL barely changed (-4% to +7%).
- Full vLLM launch command, three-configuration benchmarks, and links to the open-source gpu-unlock, 3080-20gb-rebar, and 3080-20g-p2p repos included.
More from Infra
- Sam Altman: robots building robots and data centers building data centers form another AI flywheel — haider1 · 2026-10-26
- Middle schooler hand-writes Metal RMSNorm kernel for own inference engine on Apple Silicon — dosco · 2026-10-26
- Default-to-zero: a model-name mismatch silently wiped all LLM costs to $0 — Atm1n9 · 2026-10-26
- Dev: I regret buying software licenses, should have bought more compute — cephaloform · 2026-10-26
- Musk: 200+ neoclouds face 'guppy-level death' as debt markets shut for AI-only firms — Yuchenj_UW · 2026-10-26
- Tailscale VP of Engineering responds to SSH vuln concerns: no need to disable it yet — basedjensen · 2026-10-26