OpenAI’s new signature revives the debate over open-weight safety checks
JacquesThibs · x · 2026-07-25
The author says OpenAI has signed the agreement, but is unsure what to make of it.
They argue that open-source or open-weight systems should still undergo safety testing before being embedded into societal infrastructure. Their core point is that open weights are not the same as code, and in practice there is no real regulatory body that inspects open-source models to decide whether they should be banned.
The post is less an anti-open-source stance than a call for standards around safety, hidden loyalties, and oversight.
More from AGI Musings
- Adam Marblestone's Podcast Reading List: Evolution of Intelligence to Digital Minds — KordingLab · 2026-09-11
- Superintelligence will be maximum good, not stupid or evil, argues Patterson — davidpattersonx · 2026-09-11
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Should AI models be taught morality? Breakout incidents expose missing ethical training — Pfungus_ · 2026-09-11
- SoftBank's Masayoshi Son predicts 100 trillion self-replicating AIs: "humans' era as top life form is ending" — Puzzleheaded-King584 · 2026-09-11
- We are witnessing the unreasonable effectiveness of inference-time scaling — sqcai · 2026-09-11