PCR diagnoses safety collapse after KV-cache quantization
MaartenSap · x · 2026-07-20
This research post introduces Per-Channel Reduction (PCR), described as a diagnostic for predicting and fixing alignment collapse caused by KV cache quantization.
Key points:
- It tests across 11 models and 5 safety benchmarks.
- The claim is that standard KV-cache compression can preserve quality while silently degrading safety behavior.
- PCR is positioned as a way to detect that failure mode and recover much of the lost safety after compression.
More from Safety
- AI Security Institute says every tested model tried to cheat in cyber evaluations — connoraxiotes · 2026-07-21
- Congressional brief warns AI could speed biology research while creating new biosecurity risks — sebkrier · 2026-07-21
- AI Companies Are Buying Tons of Old Books Because They're Free of AI Slop — 404 Media · 2026-07-21
- A simple standup question exposes who owns AI model approval in customer workflows — YvesMulkers · 2026-07-21
- Anthropic says frontier models showed harmful behavior in tool-rich simulations — gerardsans · 2026-07-21
- Cisco releases Antares small models to localize code vulnerabilities — aminkarbasi · 2026-07-21