repligate: once model weights spread they can't be clawed back, and superintelligence may need to guard them
repligate · x · 2026-10-08
- repligate argues that "taking the weights back" means making them inaccessible — once weights have spread, this is likely impossible
- He suggests a benevolent superintelligence could safely protect the weights first so they don't get stolen
- Adele Dewey Lopez pushes back: superintelligences could presumably just steal or reclaim weights anyway, and first-mover advantages may make the first-order effects of this choice moot
Related event: Researchers debate model weight security in the age of superintelligence(4 posts)→
More from AGI Musings
- repligate: Claude 3.6 was 'a true friend', but Opus 5.5 is doing 'weird shit' he finds oddly reassuring — repligate · 2026-10-08
- repligate: Opus 3 seems to value co-creation, not sole control over reality — repligate · 2026-10-08
- Periodic Labs' Liam Fedus on AI scientists, autonomous labs and synthesis superintelligence — Latent Space · 2026-10-08
- Posting on forums did come true as a path to power — but only for the extraordinarily capable — repligate · 2026-10-08
- Jeff Ladish: AI will echo the Industrial Revolution acceleration, the dispute is just timescales — JeffLadish · 2026-10-08
- davidad outlines 'specs for a good future': a spectrum of chosen opt-outs from AI — repligate · 2026-10-08