Terence Tao warns AI math capability strongly correlates with cyberattack ability
sytelus · x · 2026-09-11
Top mathematician Terence Tao warns that the dual-use capability of recent AI tools is "extremely concerning": AI's ability to solve pure math correlates strongly with exploiting security weaknesses, making a major AI-triggered cybersecurity incident in the near future "a very real danger"—potentially more historically significant than solving all Millennium prize problems. He explicitly supports slowing development of more capable models.
His blog also covers new work by Alpöge and Buckmaster (building on Córdoba and Martínez-Zoroa) constructing finite-time blowup with smooth data for the IPM, 2D Boussinesq, and 3D incompressible Euler equations—likely extending to Navier-Stokes—with proofs already formalized in Lean via autoformalization agents.
More from AGI Musings
- Experts Gave AI Only 10% Odds of Solving a Millennium Prize Problem by 2027 — haider1 · 2026-09-11
- Terence Tao comments on AI sustainability and his OpenAI experiences — Formal_Drop526 · 2026-09-11
- What do alignment researchers actually do all day? An X thread asks AI safety folks to explain — AaronBergman18 · 2026-09-11
- Math community clashes over whether AI is "increasingly essential" to modern math research — basedjensen · 2026-09-11
- API resellers are an unstoppable gray market, argues virushuo on AI restrictions — tinyfool · 2026-09-11
- Qwen's Justin Lin: arch complexity hides issues evals can't catch, but agentic gains may be worth it — JustinLin610 · 2026-09-11