Pedro Domingos: Transformers just read, write and combine symbols in embedding space

pmddomingos · x · 2026-10-18

Computer scientist Pedro Domingos, author of The Master Algorithm, offers a one-line reduction of what transformers actually do: they read, write and combine symbols in embedding space — nothing else. The statement distills his long-running argument that LLMs are fundamentally symbol manipulators, continuing the debate over whether transformers are genuine symbolic systems.

Original post →

More from AGI Musings

AGI Musings channel →