Dynamic weight grafting localizes how LLMs store facts learned during finetuning
ChenhaoTan · x · 2026-10-06
An arXiv paper proposes dynamic weight grafting: selectively grafting weight subsets from a finetuned model onto the pretrained model to localize where newly finetuned facts (new movies, new pope, etc.) live. The study finds two distinct retrieval pathways: 'enriching' the residual stream with relation information while processing entity tokens, and 'recalling' the fact at the final token position. Both pathways are sometimes jointly needed, otherwise either alone suffices, and the recall pathway is localized to specific components. The tweet also notes a related trick: finetuning the base model with next-token prediction on synthetic documents and applying that weight update directly to the post-trained model works.
More from Research
- Darmok AI solves all 7 Times Crossword Championship puzzles, beats human champ by 3m13s — rohanpaul_ai · 2026-11-22
- Do adaptive optimizers still work? Reddit users doubt it for flow-matching models — Inevitable_Pen9043 · 2026-11-22
- Thinking Machines' loop dial tested: 3 inner loops cut written reasoning 41% while MATH accuracy rose to 99% — SonglinYang4 · 2026-11-22
- Levent Prize proposal: compress AI math proofs into human-readable theory — jessi_cata · 2026-11-22
- After AI cracked Riemann and Fermat in Lean, Reddit asks: Turing Award for Lean creator de Moura? — coconautico · 2026-11-22
- We've seen Uranus once: Voyager 2's five-hour flyby shaped 40 years of conclusions — r0ck3t23 · 2026-11-22