Notion's AI Lead: Stop Winning on Token Economics, Route 75% of Traffic to Cut Costs
AI Engineer · youtube · 2026-07-24
Sarah Sachs, Notion's AI engineering lead, breaks down how enterprises can escape the "pricing traps" set by frontier model labs. She points out that models are quietly increasing prices every month (via token inflation or rapid deprecation), turning companies into "AI poor" if their business doesn't grow proportionally.
Core Strategy: Win on Product, Not Token Economics
- Your Supplier is Your Competitor: Buying tokens from a lab that also builds first-party products means paying a markup on a markup, with a high risk of lock-in.
- Model Agnostic (AI Switzerland): Notion's Auto Model quietly routes about 75% of traffic based on "cost per capability per second" and swaps providers underneath.
- Tiered Processing: Stop using frontier models for simple tasks (like triaging emails with Opus). Open-weight models should handle the moderate middle, and CPUs should be preferred over GPUs for basic tasks like turning a CSV into a PDF.
The talk concludes with a live demo of Notion Agents orchestrating tasks: scoping a task, tagging teammates, and opening a PR.
More from coding & agent
- NVIDIA says Nemotron 3 Ultra hit 97.1% on agentic RTL chip-design tasks — NVIDIAAI · 2026-07-27
- Tokyo Agent Forge hackathon shipped production-ready AI agents in one day — DavidBennett__ · 2026-07-27
- Long-running agents will need immutable event logs, this thread argues — sebpaquet · 2026-07-27
- Agentic Data Science in Practice: Agents Write Code but Answer Wrong Questions — hugobowne · 2026-07-27
- A VS Code extension adds Markdown-style highlighting to Alchemy string templates — samgoodwin89 · 2026-07-27
- Claude’s Stripe MCP connector is being called unusable after repeated disconnects — evielync · 2026-07-27