What's the best small abliterated local model as of Nov 2026?
SignatureMoney6648 · reddit · 2026-11-03
A Redditor uses Huihui-ai's Qwen3.8-27B-abliterated for refusal-free local inference and asks whether there's a better small option, given no datacenter and a ceiling around Qwen3.8-Flash-Next at 2-3 bit quant. Core question: a larger MoE at 2-3 bits vs a smaller dense model at higher quant — does aggressive quantization stack badly with abliteration? They request model/quant/hardware/tokens-per-second comparisons.
More from Models
- Rumor: OpenAI model solved Navier-Stokes millennium problem and 300+ open math problems at ~3h compute each — haider1 · 2026-11-03
- AgentTime Update: GPT Models Lead Time-Awareness, Best Forecast Miss Is 2.26× — maksym_andr · 2026-11-03
- paul_cal catalogs the untold failures of LLM tuning — paul_cal · 2026-11-03
- DeepSeek V5 reportedly to be pretrained on Huawei Ascend chips, Ascend 960DT due Q1 2027 — teortaxesTex · 2026-11-03
- Rumors swirl of massive GPT-6.5 pretraining run reportedly using millions of GPUs — VraserX · 2026-11-03
- Tsinghua spinoff Apex Intelligence open-weights Apex-35B, built by automated AI research system — jiqizhixin · 2026-11-03