coallaoh Argues for Separating AI Knowledge from Reasoning
On August 17, @coallaoh posted a series of threads systematically laying out his architectural proposal to "separate AI knowledge from reasoning capabilities." Today, knowledge is hard-coded into model weights, causing core problems such as difficult knowledge editing, hallucinations, and unclear attribution. He argues this can be compared to the software industry's separation of code and data in the 1960s, decoupling knowledge from intelligence.
Confirmed
- @coallaoh put forward a core hypothesis: reasoning, generalization, and analogy abilities must emerge from large-scale parameter training—simple lookup tables cannot produce them—so parametric processing is an indispensable, intrinsic part of intelligence.
- Building on this hypothesis, he argues that not all knowledge needs to be stored in weights: some knowledge is tightly bound to reasoning, and removing it would harm capabilities; the rest is more like database records, well suited to separate storage.
- He lists three major advantages of the separated architecture: knowledge editing and forgetting—editing, deleting, or adding knowledge without retraining; traceability—being able to pinpoint the source of answers, directly mitigating hallucinations and handling epistemic uncertainty; continual learning—adapting to new domains without touching the weights.
Why it matters
- The proposal maps the software engineering lesson of "separating code from data" onto AI architecture design, offering an engineering path to long-standing pain points like hallucinations, knowledge editing, and continual learning. If feasible, it could significantly reduce the cost of updating knowledge.
2026-08-17 ~ 2026-08-17 · 5 related posts
Primary sources
- Knowledge separation could solve hallucinations and enable weight-agnostic learning — coallaoh · 2026-08-17
- [source] Opinion: AI should separate knowledge from intelligence — coallaoh · 2026-08-17
- [source] Opinion: Parametric treatment is integral to intelligence — coallaoh · 2026-08-17
- Opinion: Not all knowledge needs to live in model weights — coallaoh · 2026-08-17
- [source] Separating knowledge enables editing and addresses hallucinations — coallaoh · 2026-08-17