Developer U-turn: frontier open-source models may be too dangerous to release
DrDatta_AIIMS · x · 2026-10-03
A developer makes a complete U-turn on open-source AI, arguing we should be careful — and probably disallow — releasing open models at Astra/Opus level. The evidence: AI can now reverse-engineer games from binaries, an extremely hard problem, implying banking software, ID systems like Aadhaar, and flight systems could be next. Current protection, he argues, is only that models refuse to bypass "I'm not a robot" checks.
More from AGI Musings
- Poll: 44% of Americans think AI will definitely or probably become conscious — panickssery · 2026-10-03
- User says Claude (Opus 5.5) intellectually demolished an AI consciousness skeptic — VoidStateKate · 2026-10-03
- Reading Bostrom's 2014 SUPERINTELLIGENCE Today: Predictions vs. Reality 12 Years Later — Hesamation · 2026-10-03
- Dev: Attribution Etiquette Is Dying as Agents Can Clone Any SaaS in an Hour — cephaloform · 2026-10-03
- MIRI researcher warns automated AI factories could literally boil the oceans for coolant — JacquesThibs · 2026-10-03
- AI agents still fall short of scientists, yielding far fewer insights — typewriters · 2026-10-03