oMLX ports antirez's ds4 directional steering, cuts Qwen3.8 verbosity ~50% with ~0 NLL cost

Undici77 · reddit · 2026-11-20

A Redditor ported antirez's ds4 directional steering idea into the local inference engine oMLX and benchmarked it on Qwen3.8 Flash Next.

How it works: a "pack" learns one direction per layer from paired prompts (e.g. succinct vs verbose requests); at inference a hook shifts each layer's attention-branch output along that direction with live-adjustable strength — no fine-tuning, and nothing changes unless a pack is set.

Results (MacBook Pro 14" M4 Max 128GB, oQ4e+MTP, 100-pair verbosity pack, temp 0):

Code is on the steering-experimental branch, with a call for votes to merge upstream.

Original post →

More from Infra

Infra channel →