Preserving plaintext CoTs will look like an alchemical era of observability, argues loop transformer architect

bookwormengr · x · 2026-09-11

tszzl, architect of the loop transformer, argues that the current effort to preserve plaintext chain-of-thought as a form of observability will one day look like an alchemical era — we could do much better by understanding the model's alien ontology from the ground up. A reply quips the message to OpenAI's security folks as "no CoT, no distillation," highlighting the tension between CoT monitoring and distillation.

Original post →

Preserving plaintext CoTs will look like an alchemical era of observability, argues loop transformer architect

More from AGI Musings