Researchers Discuss Using a Decision Model as MoE Router
A researcher proposed using a decision model as the router in MoE architectures, sparking discussion; developer KrishD noted he had already used an LLM classification head for routing decisions in an August 2025 talk, while the original proposer clarified the idea involves routing tokens across models based on activations.
2026-10-23 ~ 2026-10-23 · 3 related posts
- MoE but with a decision model as the router — 'cite this tweet for your paper' — ariG23498 · 2026-10-23
- Dev says he built an LLM classifier-head router for MoE back in August 2025 — officialKrishD · 2026-10-23
- Clarifying decision-model routing: routing activations across models, not just classifying — ariG23498 · 2026-10-23