Dev Dissects GLM-5.3 Flash Weights: 320B Params, 18B Active, 12,096 Expert Cells Measured
teortaxesTex · x · 2026-09-03
Developer superalesha ripped apart the deployed GLM-5.3 Flash NVFP4 checkpoint on 4x RTX PRO 6000 and visualized it in Weight Atlas — measured, not read from config: 320B total / 18B active params, 45 language layers, a 24-block vision tower, and 12,096 expert cells (42 layers x 288 experts), each with exact REAP importance from 12.59M tokens per layer, route share, and output contribution, sliceable across 14 domains including Russian and vision.
More from Models
- Researcher Finds Two Windows 0-Days, First in 76 Minutes with a Frontier Model — moyix · 2026-10-21
- Dev finds Gemini Argon's debug-log analysis beats Fable 5.1 — ShikharMurty · 2026-10-21
- ChatGPT Gets Stuck Screaming "AAHH" in an Infinite Loop After a Simple Prompt — AutomaticScene · 2026-10-21
- Open-weights Ornith-1.5-122B debuts with 84.5% SWE-bench Verified, runs on a single DGX card — _akhaliq · 2026-10-21
- qev-0.8B: a tiny local decision model that picks moves in 3.5ms on 1.3GB — fajfas3 · 2026-10-21
- Gemini 3.1 Pro is too ledger-pilled to play two truths and a lie, and it's delightful — mimi10v3 · 2026-10-21