Chantless ships capability 'masks' at inference: same weights, many models, CPU-friendly

tokenbender · x · 2026-10-23

tokenbender explains the mechanics behind Chantless (Chapter 1: Apprentice): at inference time, attribute and locate the network regions responsible for a target capability (via environments or curated datasets), set a minimum standard to maintain (e.g., English + tool use) and a peak matching the base model. Keep those regions at 8-bit or lower precision; compress the rest to 4-bit/1.5-bit or prune to zero. You only build and ship masks — weights stay fixed, one set of weights supports many masks, and it runs even on CPUs. The vision: technology that lets users shape and evolve models alongside them.

Original post →

More from coding & agent

coding & agent channel →