Unified 27B local agent model open-sourced: vision, typed decider, abliterated, runs on 16GB VRAM
ButtercupLyn100 · reddit · 2026-11-16
A Reddit user released Qwen3.8-27B-Perplexing-Pegasus-Heretic (Apache-2.0), a merged open-source checkpoint that unifies what local agent stacks usually run as three separate 20B+ models: a vision parser, a fast typed-decision model, and an abliterated model to avoid false-positive refusals.
Key details:
- Based on Qwen3.8-27B with multimodal vision + chat + thinking + tool calling
- Perplexity pplx-decider typed-decision readout head alongside intact lmhead
- Heretic ARA abliteration: 0/8 refusal probes while keeping 30/30 typed-decision agreement with the base Pegasus model
- All 15 MTP tensors preserved; blk.64 kept at Q80 in IQ/3-bit quants
- Fits 16GB VRAM (IQ3XXS / Q3KM + mmproj) or 24GB (Q4KM)
Four repos on Hugging Face under webbrain-one: GGUF + mmproj F16 (llama.cpp/LM Studio), AutoRound INT4 (vLLM on Intel Arc Pro B70 and CUDA), NVFP4 + FP8 (Blackwell sm100/sm120 with MTP), and BF16 base weights.
More from coding & agent
- "Programmers are now a liability": solo founder keeps only coding outsourced — yangyi · 2026-11-16
- json-render for Swift brings native Generative UI to iOS and macOS — amos_gyamfi · 2026-11-16
- Sentry CEO tries tenant SQLite on Durable Objects, back to Postgres in 30 minutes — zeeg · 2026-11-16
- Stanford CS329Z draws 100+ students in debut, publishes full syllabus with industry API credits — FinanceYF5 · 2026-11-16
- SWE-bench co-creator designs Stanford CS329Z HW2 on Terminal-Bench-style agent evals — FinanceYF5 · 2026-11-16
- Stanford CS329Z open-sources HW1: build an agent harness from scratch for under $5 — FinanceYF5 · 2026-11-16