Rock Matrix Open-Sources EdgeRock-4B with Constant-Memory KV Cache
Rock Matrix open-sourced EdgeRock-4B, a vision-language model with a fixed 72MiB KV cache that saves 99.1% of VRAM versus its Qwen3.5-4B base. It runs locally on a MacBook Pro at about 9 tokens/s, and disabling its Rock Memory Anchors crashes long-context accuracy from 94.1% to 0.4%.
2026-10-31 ~ 2026-10-31 · 3 related posts
- Episode 1: EdgeRock Open-Sourced: Constant 72 MiB KV Cache for 256K Context(2026-10-27, 4 posts)
- Episode 2: Rock Matrix Open-Sources EdgeRock-4B with Constant-Memory KV Cache(2026-10-31, 3 posts)
- EdgeRock-4B open-sourced with fixed 72MiB KV cache, 99.1% less memory than base — testingcatalog · 2026-10-31
- EdgeRock-4B runs locally on MacBook: first token in 4.6s, ~9 tok/s on M5 Pro — testingcatalog · 2026-10-31
- EdgeRock-4B architecture: RMA anchors lift long-context accuracy from 0.4% to 94.1% — testingcatalog · 2026-10-31