Running Qwen3-27B on 16GB VRAM: struggling with pi.dev context compaction plugins
darksteelsteed · reddit · 2026-09-13
A user running NVFP4-quantized Qwen3.8-27B via llama.cpp on an RTX 5080 16GB (48k context, 12 t/s) reports pi.dev compacts at the wrong times, truncating responses. They tried npm:max-context (broken), pi-observational-memory (works partially at 0.75 threshold), and pi-blackhole (never compacts), and criticize pi.dev for keeping compaction settings separate from model settings—painful when switching between small-context local models. Full llama-server flags included.
More from coding & agent
- Todoist's self-healing agent auto-fixes 1 in 5 Sentry issues and opens PRs — zeeg · 2026-10-31
- Dev's Multica 1.0 build log: 432M tokens, 89 agent runs, just $183 — jiayuan_jy · 2026-10-31
- Stardock's QA now runs agents that play the game and file reports — draginol · 2026-10-31
- Limma MCP structures unstructured data end-to-end so agents never miss a detail — FlimsyIngenuity7248 · 2026-10-31
- Agent audit metric: can you name which tests ran and files changed without reading its summary? — ronbodkin · 2026-10-31
- FlowSense MCP lets Claude Code inspect and firewall your Mac's network traffic locally — hani_q · 2026-10-31