Zvi's framework: honeypot attempt reductions up to 50-75% are fine, beyond that alarming
TheZvi · x · 2026-09-06
Zvi responds to a Bayesian critique of honeypot eval interpretation, arguing that reduced honeypot attempts remain a good sign only within roughly 50-75% reductions, given other behaviors documented in the model card — and that larger reductions grow increasingly alarming. Modest reductions, he says, tell a consistent good story.
More from Models
- 105 Real Bugs Tested: GPT-6.1 Sol Over 10x Cheaper Than GPT-5.6 Sol — PawelHuryn · 2026-10-23
- Abliterated V4.1-Flash eval: abstract algebra drops 6pp but college math gains 5pp — teortaxesTex · 2026-10-23
- Claude users hit "model at capacity" errors hourly, canceling plans over it — Alex-Stack · 2026-10-23
- Kimi K3.1 launch imminent: 3T-param bet on RL seen as make-or-break — teortaxesTex · 2026-10-23
- Uncensored fine-tunes vanish from Hugging Face amid unexplained takedowns — umarmnaq · 2026-10-23
- Claude app menu leaks mystery model name 'Fable' as user hits limits — ezshine · 2026-10-23