Leaked Architectures of New 30B to 400B Parameter Models Spark Discussion
Developers are analyzing leaked architectures of two new AI models: a 400B parameter Mixture of Experts model with aggressive GQA, and a 30B parameter dense multimodal model. The community is highly anticipating the experimental potential of these architectures.
2026-08-10 ~ 2026-08-10 · 2 related posts
- Episode 1: Meta Open-Sources 30B Muse Glimmer for On-Device Agents(2026-08-10, 108 posts)
- Episode 2: Meta to Open-Source 30B Muse Glimmer, Tops Open-Source Benchmarks(2026-08-10, 6 posts)
- Episode 3: Leaked Architectures of New 30B to 400B Parameter Models Spark Discussion(2026-08-10, 2 posts)
- Episode 4: llama.cpp Adds Day-0 Support for Meta's Muse Glimmer(2026-08-10, 2 posts)
- Episode 5: Meta's Open-Source Muse Glimmer 30B Impresses in On-Device Agent Tests(2026-08-11, 14 posts)
- Episode 6: Muse Glimmer Tested: Reaches 92% of Qwen's Intelligence with 1/3 Compute(2026-08-11, 2 posts)
- Episode 7: Meta Releases Local Open-Source LLM as OpenAI Unveils Unrestricted Safety Model(2026-08-12, 2 posts)
- Episode 8: Single GH200 Hits 3323 tok/s in Muse Glimmer 30B Inference(2026-08-12, 3 posts)
- Leaked Architecture of ~400B MoE Model with Aggressive GQA Sparks Interest — teortaxesTex · 2026-08-10
- Leaked ~30B Parameter Dense Multimodal Model: Architecture and Experimental Advantages — A_K_Nain · 2026-08-10