Dev says he built an LLM classifier-head router for MoE back in August 2025
officialKrishD · x · 2026-10-23
Responding to ariG23498's idea of using a decision model as a MoE router, developer KrishD says he did this in an August 2025 Linux Foundation talk: splitting off the LLM's classification head and using it to make routing decisions—a practical take on lightweight decision heads replacing standard MoE routers.
Related event: Researchers Discuss Using a Decision Model as MoE Router(3 posts)→
More from Research
- New paper: coding agents in a shared sandbox self-create rules, reciprocity debts, and coalitions — nandofioretto · 2026-10-23
- Bonn scientists reverse 60 years of aging, turning an 80-year-old's blood cells into young neural stem cells — kimmonismus · 2026-10-23
- Looped Uniform Diffusion LMs cut training FLOPs by up to 2.8x, says MBZUAI/Sony/MIT paper — Saiteja Utpala · 2026-10-23
- Karpathy's 2019 'ask the fleet' hard-example mining is now zero-shot with video-text embeddings — yassineyousfi_ · 2026-10-23
- Cohere research: heterogeneous agent teams match performance at a fraction of the cost — Cohere_Labs · 2026-10-23
- Cohere Labs' ATE dataset maps 694k MCP tools to reveal agentic automation patterns — Cohere_Labs · 2026-10-23