UWaterloo's Yuntian Deng Open-Sources Implicit CoT, NeuralOS and More

yuntiandeng · x · 2026-09-16

UWaterloo assistant professor Yuntian Deng shares his lab's open-source work: Implicit Chain-of-Thought (internalizing reasoning into hidden computation — a 12-layer GPT-2 hits 99.5% accuracy multiplying two 20-digit numbers without emitting steps), NeuralOS for end-to-end neural simulation of computing environments, the ProgramAsWeights paradigm, plus his course and homepage.

His research focuses on internalizing explicit reasoning into implicit computation and studying real-world LLM usage at scale; WildChat was used by OpenAI's o1 and Anthropic's Claude 3 for safety evaluation, and his OpenNMT toolkit is widely adopted.

Related event: Yuntian Deng Open-Sources Program-as-Weights and NeuralOS Research(2 posts)→

Original post →

More from Research

Research channel →