Open-source chaff framework rethinks agents for group chats: 89% fewer output tokens, 55% cache hits

uriwa · reddit · 2026-11-22

Running agents in real messaging channels and live voice calls led the author to open-source chaff (@uriv/chaff, MIT), built on the thesis that most harnesses assume a 1-on-1 terminal loop and fall apart in group chats.

Key production-tested design choices:

Numbers: vs Pi on ClawBench at constant model, cutting startup/narration bloat cut output tokens by 89.2% (944 vs 8,711) and total tokens by 51.4%; on tau-bench Retail, deterministic history prefixes took prompt cache hit rate from 0% to 55.2%.

Related event: Open-Source Chaff Framework Cuts Group-Chat Agent Token Output by 89%(2 posts)→

Original post →

More from coding & agent

coding & agent channel →