Pedro Domingos blasts OpenAI: looped transformers aren't more opaque, CoT transparency is fiction

pmddomingos · x · 2026-09-03

ML researcher Pedro Domingos publicly pushed back on OpenAI, arguing that looped transformers are no more opaque than regular ones and should simply be run to whatever depth is needed. He added that relying on chains of thought to guarantee reasoning transparency is "fiction to begin with." The post is a notable interpretability debate jab at OpenAI's architecture and narrative choices.

Original post →

More from Models

Models channel →