Infinity, Impossibility, and NN Instability
iainrfharper · reddit · 2026-07-15
Inspired by Matthew Colbrook's PNAS paper on "unstable neural networks" and logician Kurt Gödel's theories, the author explores the fundamental logical limitations of AI development.
The industry widely believes that continuously scaling data and compute will allow AI to solve any problem. However, the article points out that "impossibility" proofs in mathematics and logic suggest certain problems simply cannot be overcome by brute-forcing compute. It's a great read for those interested in the boundaries of logic and AI foundational theory.
More from AGI Musings
- Gary Marcus says LLMs still cannot really do math on their own — GaryMarcus · 2026-07-22
- Gary Marcus says LLM math skills are like knowing only a car’s engine size — GaryMarcus · 2026-07-22
- AI may make digital work infinitely leveraged while offline life gets more human — illscience · 2026-07-22
- Better AI math could save researchers time by killing false conjectures earlier — prateekj · 2026-07-22
- AI’s economic forecasts are split by nearly a quadrillion dollars by 2035 — bittingthembits · 2026-07-22
- Open source is becoming tech’s soft power, says Kevin Xu — kevinsxu · 2026-07-22