Mistral open-weights 1T-param Le Chonk; TRL day-0 LoRA SFT on a single node
FerdinandMom · x · 2026-10-30
Mistral released the open weights of Le Chonk, targeting agentic coding and cybersecurity:
- Coding: ranks #1 among open models on Cognition's FrontierCode and sets a new Pareto-efficiency benchmark on Artificial Analysis.
- Cyberdefense: claims SOTA, tested by CrowdStrike, Cloudflare, Rubrik, Zscaler and others.
- Sovereignty: weights downloadable on Hugging Face, customizable via Mistral Forge, deployable anywhere.
Hugging Face's TRL shipped day-0 support to post-train the 1T-parameter model on a single node: LoRA SFT on top of FP8 weights, 32.7k tokens per step in 8 seconds, 142 GiB per GPU on 8×B300, using expert parallelism + FSDP. The training recipe is open-sourced.
Related event: Mistral Open-Sources Le Chonk, Topping Open Coding Leaderboards(3 posts)→
More from coding & agent
- A 4B Model Verifies a Coding Agent 70x Its Size at Just 4% of Steps, 9-13% Extra Cost — petrusenko_max · 2026-10-30
- Static RAG eval sets go stale: treat your eval dataset as a pipeline, not a file — paulabartabajo_ · 2026-10-30
- What took a week now takes ~5 minutes with Sol or Opus coding agents — D3VAUX · 2026-10-30
- dhh: 'Review every line' is AI psychosis — the future is verifying outcomes, not code — CtrlAltDwayne · 2026-10-30
- Do you need an AI QA agent writing Playwright tests when AI already reviews PRs? — Infinite-Fly-2756 · 2026-10-30
- Octoverse: Claude Code tops fastest-growing repos; helium lands at #9 — uwukko · 2026-10-30