Do Neural Networks Stumble Into Intelligence by Chance? A Reddit Deep-Dive on Architectural Determinism

Lost-Quiet-2021 · reddit · 2026-10-28

A Reddit long-post asks how deterministic neural network design really is. The author argues that despite experimental tuning of depth and size, networks may have "stumbled into" intelligence by chance rather than through understood mechanisms — like early humans making fire by friction without knowing the chemistry.

Key points: neural architectures differ vastly from the human brain, the only other intelligence we know; data centers draw terawatts yet remain far less efficient than a tiny fraction of a brain; a mathematical definition of intelligence likely wouldn't align 100% with the human brain either.

Open questions posed: does this inefficiency block AGI, or could recursive self-improvement keep switching paradigms and drive unbounded exponential gains?

Original post →

More from AGI Musings

AGI Musings channel →