HANDRAISER's Per-Task Numbers: 48.9% Cost Cut on Debate, 32.2% on Average
lileics · x · 2026-09-23
From the HANDRAISER thread, per-task results with Llama-3.1-8B listeners: communication cost down 24.3% on Text Pictionary, 23.4% on Meeting Scheduling, and 48.9% on MMLU-Pro Debate — averaging 32.2% lower cost with comparable or better task performance. Full details in the companion post.
More from Research
- Author says his CHI2027 ADR paper was better than papers he reviewed — windx0303 · 2026-11-12
- Google launches AlphaGenome 2 to predict how DNA variants affect specific cell types — sundarpichai · 2026-11-12
- New learning rule boosts Hopfield network memory capacity over 10×, per Nature Communications study — bravo_abad · 2026-11-12
- CoRL results show sim-only training now delivers top real-world robot performance — carlosdponx · 2026-11-12
- Google team pushes neural cellular automata to multi-step visual reasoning — bratton · 2026-11-12
- NeoMME: 255x smaller multimodal embeddings while keeping >95% nDCG@10 — antoine_chaffin · 2026-11-12