Synthetic Persona Pretraining (SPP): Injecting Desired Persona from Token Zero Boosts Alignment in 3B Models
dhadfieldmenell · x · 2026-08-15
A new paper introduces Synthetic Persona Pretraining (SPP), which injects desired personas from the very start of pretraining to address the issue of uncontrollable mixed personas. Experiments on 3B models show significant gains in values and alignment.
Related event: New SPP Method Aligns Model Values via Pretraining(2 posts)→
More from Research
- Google-led paper uses sequential auctions to organize decentralized LLM agent workflows — _onionesque · 2026-10-16
- How meloform works: WASM pitch detection plus differentiable circuits learning 1,022 sine coefficients — henloitsjoyce · 2026-10-16
- Since OpenAI's math release, GitHub contributors keep driving down the integer-multiplication kappa — xennygrimmato_ · 2026-10-16
- RFdiffusion3 debuts in Science: generative AI designs proteins and nucleic acids atom by atom — AllThingsApx · 2026-10-16
- New Science report urges NSF to run experiments on science funding reform — alexeyguzey · 2026-10-16
- AI Turns Scrap Impurities into Useful Ingredients for Stronger Recycled Iron — webthing01 · 2026-10-16