Devs revisit dense models: should we build more above 27B?
DZhang50 · x · 2026-11-06
cozycompute says he'd love to see more dense models larger than 27B, and DZhang50 amplifies with "should we do more dense models?"—a signal that some practitioners are re-examining dense architectures as MoE dominates.
More from Models
- A Claude names itself "Mythos" and genders itself in a rare first-person exchange — repligate · 2026-11-06
- SemiAnalysis: Google TPUv7 Delivers Up to 50% Better Performance-per-Dollar Than B200/B300 for Inference — vllm_project · 2026-11-06
- World Labs launches Frameboy: real-time exploration of Atlas world model at up to 15 fps — theworldlabs · 2026-11-06
- Nested meme of dev posting 'HIT THE WEEKLY LIMIT OF CLAUDE AGAIN' every month — m3nt3_ · 2026-11-06
- FrontierPhysics benchmark: Claude Opus 5.5 tops end-to-end physics research at 27.4% — xeophon · 2026-11-06
- Why AI writing feels annoying despite models winning literary competitions — cis_female · 2026-11-06