Novel Combination Isn't Invention: Does LLM Architecture Lack a Mechanism for New Conceptual Frameworks?
No_Will_5010 · reddit · 2026-09-23
A long-form essay argues that current LLMs excel at recall, generalization, and recombining concepts, but may lack the mechanism to recognize when an existing representation is insufficient and create a genuinely new conceptual framework — the kind of framework-level invention behind the computer. The author contends that more data, parameters, RL, and inference compute may improve reasoning and search without producing this ability, and distinguishes producing a novel answer from true invention (new representation → framework → predictions → testing → revision). Closes with open questions on whether scaling Transformers can yield the machinery of invention or whether it requires a different architecture or model-plus-tools setup.
Related event: Essay Questions Whether LLMs Can Invent Genuinely New Conceptual Frameworks(2 posts)→
More from AGI Musings
- Award-sweeping Haitian-Canadian novel revealed as AI-written, sparking debate on AI prose appeal — BlancheMinerva · 2026-09-23
- Pangram urges calm in French AI-written novel prize controversy — AymericRoucher · 2026-09-23
- Martin Casado: math and physics might just be apps of computer science — burny_tech · 2026-09-23
- Two personal AIs tried to schedule coffee: agent interop needs a protocol — signulll · 2026-09-23
- Researcher pushes back on "stochastic parrots": LLMs aren't autocomplete — aran_nayebi · 2026-09-23
- AI safety hypocrisy: call for a pause, then ship bigger models anyway — xiaohu · 2026-09-23