Gary Marcus: universal approximation doesn't mean networks can learn

GaryMarcus · x · 2026-11-22

Gary Marcus endorses Chomba Bupe's point that the universal approximation theorem only says a neural network can approximate any function in principle — not that it can learn any function from input-output pairs.

Marcus claims he made exactly this argument 25 years ago in his first book and that its importance is still barely understood, continuing his critique of deep learning's theoretical foundations.

Original post →

More from AGI Musings

AGI Musings channel →