Running Qwen3-27B on 16GB VRAM: struggling with pi.dev context compaction plugins
darksteelsteed · reddit · 2026-09-13
A user running NVFP4-quantized Qwen3.8-27B via llama.cpp on an RTX 5080 16GB (48k context, 12 t/s) reports pi.dev compacts at the wrong times, truncating responses. They tried npm:max-context (broken), pi-observational-memory (works partially at 0.75 threshold), and pi-blackhole (never compacts), and criticize pi.dev for keeping compaction settings separate from model settings—painful when switching between small-context local models. Full llama-server flags included.
More from coding & agent
- dhh on coding in the AI era: code is no longer the bottleneck, humans are — NERDDISCO · 2026-10-31
- pi-rs: Open Source Rust Port of the pi Coding Agent Ships pi-durable, No Node Needed — jasonkneen · 2026-10-31
- Open-source ComfyUI Motion Previs Studio brings 3D camera blocking to AI video — navarisun · 2026-10-31
- Replit agent drives Chrome via Computer Use in new demo, CEO Amjad Masad amplifies — amasad · 2026-10-31
- Every Used Codex and Agents to Survive the Railway Credential Breach — every · 2026-10-31
- Google's New /goto Anti-Bot Delay Hits SERP-Reselling Agent Search Firms — jobergum · 2026-10-31