Input 4-5x reduction achieved with sentence/keyword trie on chat

No_Sky9786 · reddit · 2026-08-17

Shared a sentence and keyword-based trie structure that reduces chat input scale by 4-5x. Struggling with automatic budget selection; at 25%, accuracy matches benchmarks and performs well on actual chat input, though it often retrieves too much. Looking for a better retrieval algorithm than CELF.

Original post →

More from Infra

Infra channel →