Post-Training Increments Can Transfer Across Models
tuvllms · x · 2026-07-09
A recent study suggests that post-training shifts can be compressed into transferable logit deltas, capable of moving across different model scales and families. The author notes that migrating a delta extracted from a 1.5B Qwen model to Llama-3-8B resulted in a 15% boost on GSM8K.
The post connects this finding to concepts like task arithmetic, the Master Key Hypothesis, and fine-tuning/alignment transfer. It stresses that such transfers don't require models from the same family—just a simple vocabulary bridge to achieve logit grafting.
More from Research
- Why a 1GW Chinese AI data center may be plausible after all — teortaxesTex · 2026-07-22
- Chinese AI labs are now treating distillation obfuscation as the top research topic — pmddomingos · 2026-07-22
- RSS launches under OMSF to push structural biology data modeling at scale — MoAlQuraishi · 2026-07-22
- enFoldX turns AlphaFold3 ensemble noise into a TCR–peptide–MHC predictor — quaidmorris · 2026-07-22
- enFoldX tops 8 neoantigen scans and an unseen-peptide benchmark — quaidmorris · 2026-07-22
- enFoldX reaches AUC 0.82 on human VDJdb and transfers to mouse at 0.76 — quaidmorris · 2026-07-22