KVMem pages KV state to give agents million-token workspaces on a consumer GPU
rohanpaul_ai · x · 2026-09-23
KVMem is a KV-context virtualization system that keeps overflowed agent workspace history as paged KV state across GPU memory, host RAM, and NVMe, instead of compacting it into summaries or re-fetching text.
- On DeepSWE with Qwen3.8-27B, Pass@1 rises from 43.8% (compaction-only) to 48.4%
- History recovery is 11.4–53.8× faster than Compact+RAG across benchmarks
- On a laptop with a 24GB RTX 5090, it sustains a 1M-token workspace at 50 tokens/s; each step still sees only a bounded slice
Related event: KVMem Virtualizes Million-Token Agent Workspaces on Consumer GPUs(2 posts)→
More from coding & agent
- lattedit launches free local-first browser LaTeX editor with MCP support for coding agents — cneuralnetwork · 2026-11-11
- Rivet launches SQLite Forking: 20ms agent-thread forks with zero data copying — samgoodwin89 · 2026-11-11
- YouArt Desktop launches: AI agent edits video in CapCut, DaVinci and Premiere from client feedback — mhdfaran · 2026-11-11
- Boubou: one-command local voice AI that serves your phone and robots over Wi-Fi — LuozhuZhang · 2026-11-11
- Python 3.15 makes AttributeError actionable: suggests .append for .push mix-ups — KhuyenTran16 · 2026-11-11
- sentence-transformers maintainer releases new embedding pooling training method, code & checkpoints — tomaarsen · 2026-11-11