Small Dense Models Hard to Run? User Says MoE More Practical
Forward_Jackfruit813 · reddit · 2026-08-16
Reddit user ForwardJackfruit813 questions the value of small dense models, arguing that despite 27B parameters, they are slow and difficult to run on weak GPUs and unified memory setups, and quantize poorly. In contrast, MoE models like Qwen 3.6 MoE 35B run on more systems and quantize better. He feels dense models are no longer worth it and wonders if he's missing the point.
More from Models
- Shanghai AI Lab unveils Intern Lumina U2, a diffusion LLM unifying image, video and 3D tasks — Shanghai-AI-Laboratory · 2026-10-16
- This Week in Tech breaks down Gemini 4, OpenAI's Dots agents, and Anthropic's leaked IPO filing — LouMM · 2026-10-16
- Sentry CEO Reveals $8,972 Claude Bill as Opus 'Scope Creeps' Through Team Workloads — zeeg · 2026-10-16
- Opus 5.5 wins: Anthropic reclaims token and spend share from OpenAI in 6 days — FinanceYF5 · 2026-10-16
- will.deeb: asking why a minor lab benchmarked against a 2-month-old frontier model is usually a stupid question — willcb · 2026-10-16
- Grok plans compared: is the $200 Ultra a better deal than $300 SuperGrok Heavy? — alexcovo_eth · 2026-10-16