Notion AI lead: much of what runs on GPUs should run as CPU code

threepointone · x · 2026-10-17

Notion AI lead Sarah Sachs argues that a lot of work currently served on GPUs should actually run on CPUs via code execution.

Her reasoning: executed code brings determinism and observability, while having LLMs reinvent the process each time is token-heavy and slow. Giving agents a local file system to store intermediate thoughts and write short Python scripts has been one of the most important tools for Notion's internal agents, alongside edit and search.

Related event: Notion AI head: move agent work from GPUs back to CPUs(2 posts)→

Original post →

More from coding & agent

coding & agent channel →