Debate: are LLMs fundamentally statistical search engines, or is the analogy too loose?

TobiHb1 · x · 2026-09-01

A debate over what LLMs fundamentally are: one side claims LLMs are statistical search engines — just with a totally different indexing algorithm — which explains why they can only copy rather than create.

The rebuttal argues the analogy is so loose it loses meaning (like saying "cooking is just particle physics"), and that there is no clean code/data distinction inside an LLM where data exists to be retrieved. Consumer products calling external search engines or doing caching/RAG is an engineering add-on, not something fundamental to LLMs.

Related event: Debate: Are LLMs Just Statistical Search Engines?(3 posts)→

Original post →

More from Models

Models channel →