llama.cpp fork does live inference-time abliteration on any loaded model, no fine-tuning needed
AccountAntique9327 · reddit · 2026-10-22
Reddit user shares AbliteratedOutTheBox, a llama.cpp fork that abliterates any model you load — live at inference time, with no fine-tuning, no extra files, and no additional VRAM.
Traditional abliteration usually requires offline weight edits and exporting separate 'uncensored' model files; this project moves that step into the inference pipeline. Open-sourced on GitHub.
More from Models
- Devs push back on Grok's X data moat hype: browser use and API already cover it — brandon_galang · 2026-10-22
- Jev explained: the answer-sheet-only AI that's tens of times faster with 'zero hallucination' — dotey · 2026-10-22
- The Model Factory Is the Real Asset: Lessons from Thomson Reuters and Other Companies Training Their Own Models — bigdata · 2026-10-22
- Peter Yang reviews 4 personal agents: Claude Duet most proactive, Grok Bot wins on free X access — petergyang · 2026-10-22
- GPT-6 Astra leads Gemini 3.8 Flash 1,349 to 972 on physical agent Elo index — qinzytech · 2026-10-22
- OpenRouter data: GPT-6 Luna takes 54% of tokens but only 6% of OpenAI spend — maferase · 2026-10-22