Kimi K3 kernel researcher nathancgy4 leaves Moonshot AI
SonglinYang4 · x · 2026-10-15
Nathan Gao (@nathancgy4) has left Moonshot AI, calling his year at Kimi the best of his life. His work included optimizing KDA (Kimi Delta Attention) kernels, co-developing Attention Residuals, deep dives into optimizers and training dynamics, and building test cases for the Kimi K3 release. The retweet chain also cites a blog post exploring a future-dependent rounding effect in KDA, plus TorchTitan/Attention Gym work on training primitives for hybrid GDN/KDA attention architectures.
Related event: Kimi Core Researcher Nathan Departs Moonshot AI(2 posts)→
More from Companies & People
- Boston Dynamics shows Atlas factory: one robot a day today, one hour targeted next year — CyberRobooo · 2026-10-15
- Together AI x NVIDIA x Reflection pack a NYC builder meetup, Berlin and SF next — togethercompute · 2026-10-15
- AI Companies Play Cat-and-Mouse With Secret-Stealing Spies Amid FBI Arrest — pstAsiatech · 2026-10-15
- NDAs now ban uploading deal materials to non-enterprise Claude/ChatGPT over training concerns — sebpaquet · 2026-10-15
- Developer: an all-bot interview process signals 'you are not serious people' — soumitrashukla9 · 2026-10-15
- Barclays floats Tesla-SpaceX merger by Dec 6, which would make X the 5th largest company at $3.54T — alexmacgregor__ · 2026-10-15