Muse Glimmer's Mid-Training and SFT Recipe Revealed: 131k Context, Mixed Data
TimDarcet detailed Muse Glimmer's mid-training stages, expanding context from 32k to 131k with synthetic reasoning and targeted domain data, and its SFT recipe mixing synthetic trajectories and human data across instruction-following, reasoning, code, and math without multiple epochs.
2026-10-21 ~ 2026-10-21 · 2 related posts
- Episode 1: Muse Training Recipe: Full Logit Distillation Details Revealed(2026-10-20, 2 posts)
- Episode 2: Muse Glimmer's Mid-Training and SFT Recipe Revealed: 131k Context, Mixed Data(2026-10-21, 2 posts)
- Mid-training recipe disclosed: 32k→131k context extension, dropping logit distillation for tokens — TimDarcet · 2026-10-21
- SFT details: instruction/reasoning/code/math mix, synthetic + human traces, no epoching — TimDarcet · 2026-10-21