Leaked Architectures of New 30B to 400B Parameter Models Spark Discussion

Developers are analyzing leaked architectures of two new AI models: a 400B parameter Mixture of Experts model with aggressive GQA, and a 30B parameter dense multimodal model. The community is highly anticipating the experimental potential of these architectures.

2026-08-10 ~ 2026-08-10 · 2 related posts

• Leaked Architecture of ~400B MoE Model with Aggressive GQA Sparks Interest — teortaxesTex · 2026-08-10
• Leaked ~30B Parameter Dense Multimodal Model: Architecture and Experimental Advantages — A_K_Nain · 2026-08-10