Chantless specialist extraction: 8B model beats big model at function calling by 107.8%

tokenbender · x · 2026-10-14

tokenbender's Chantless article details a specialist-extraction methodology: define what doing a task well means, then shape a model around that standard instead of shipping all weights. Benchmarks show Qwen3-8B hitting 66.5% on BFCL single-call (100.4% of the big model, and 107.8% in a smaller config), Qwen3.8-27B scoring 77.8% on Terminal-Bench 2.1 pass@1 (104.1%), 96.67% on AIME 2025 avg@8 (97.5%), and 0.725 on RedactionBench (102.5%) — suggesting task-tuned small models can match or beat full-size models.

Related event: Chantless: Taste-Grown Custom Models with 8B Beating Giants by 107.8%(3 posts)→

Original post →

More from coding & agent

coding & agent channel →