Astra reads and writes weights directly to improve Qwen models
dbreunig · hn · 2026-11-03
A new blog post describes Astra, a "weight-space programming" approach that improves Qwen models by directly reading and writing model weights instead of relying on standard fine-tuning or prompting.
The writeup walks through locating parameters in weight space, modifying them, and validating the results — an alternative path to model improvement that bypasses the conventional training pipeline.
More from Models
- How LLM inference actually works: from 140GB weights to GPUs and model serving, explained as a story — _jaydeepkarale · 2026-11-04
- $100 of GPU time edits model weights to cut thinking tokens by 40% — jarrodwatts · 2026-11-04
- Sarvam open-sources Prism, a 44ms decision model that skips text entirely — heyshrutimishra · 2026-11-04
- Frontier models' teaching ability is 'off the charts', says dev: your 'I know kung fu' moment — shauseth · 2026-11-04
- kalomaze: crude diffusion autoencoders may lose low-frequency info at the latent stage — kalomaze · 2026-11-04
- Dev complains frontier models can't do light-touch English editing — A_K_Nain · 2026-11-04