ConvFill: a 0.6B talker reads a large reasoner's answers for fast, smart voice agents

futterneid · reddit · 2026-10-26

ConvFill, from UW UbiComp Lab students (presented at EMNLP), bridges the fast-vs-smart tradeoff in voice agents: a 0.6B talker model replies immediately to buy time while a large reasoner thinks, then reads out the reasoner's answer — like having an expert in your earbud at a panel. The author finds the core idea promising though the talker needs to be smarter. A demo built with Hugging Face (ConvFill Talker + Gemma 4 31B reasoner + Phonon 31M TTS + Qwen3-ASR 1.7B STT) is live on HF Spaces.

Related event: ConvFill: Small Talker Model Plus Big Reasoner Makes Voice Agents Fast and Smart(2 posts)→

Original post →

More from Multimodal

Multimodal channel →