New NeuroAI book chapter rebuilds Hopfield networks as a physical theory of memory
neurovium · x · 2026-09-04
Nima Dehghani released Chapter 5 of his book NeuroAI: Theoretical Foundations (on arXiv), reconstructing the Hopfield network as a physical theory of memory rather than an early neural-network algorithm.
- Reviews the pre-1982 landscape: threshold logic, Hebbian association, correlation memories, recurrent binary networks
- Isolates Hopfield's synthesis: a dynamical definition of content-addressable memory, a symmetric recurrent architecture with a Lyapunov function, Hebbian pattern embedding, and a physical account of basins, robustness, and graceful degradation
- Fully derives binary and graded-response energy functions, the signal-crosstalk decomposition, mean-field retrieval theory at extensive load, and the Amit-Gutfreund-Sompolinsky zero-temperature retrieval spinodal (α≈0.138)
- Traces the energy-based program through analog optimization networks, polynomial dense associative memories, exponential interactions, and modern continuous Hopfield updates—including the precise conditions under which the update becomes scaled dot-product attention
- Closes by separating established results from surviving principles, assumption-bound limits, and open problems, treating the network as an effective theory bounded by symmetry, locality, and point-neuron assumptions
More from Research
- SPLIT-RAG at EMNLP 2026: multi-agent graph partitioning cuts agentic RAG overhead — flosalim · 2026-09-21
- Neural network trainability boundary is fractal, shows Jascha Sohl-Dickstein — alec_helbling · 2026-09-21
- Qwen-Image 2.1 LoRA training plagued by anatomy failures, community hunts for fixes — ResidentFrame4195 · 2026-09-21
- EventCV: Open-Source Rust Library Lowers the Barrier to Event Cameras in Robotics — ssh4net · 2026-09-21
- UCL+FAIR unveil neural reasoning architecture that learns to generate and select rules — PMinervini · 2026-09-21
- NLP's surprising origins: IEEE traces natural language processing back to Kabbalist mystics — ArtificialOther · 2026-09-21