Zilliz CTO on Notion's Vector Infra: 90% Cost Cuts and the Platform Hiding Under One AI Feature
J_Luan_ · reddit · 2026-09-05
Zilliz CTO James Luan unpacks Notion's two years of vector-search infrastructure: generation-based placement to avoid resharding, 600x onboarding capacity via Spark/Airflow, serverless cutting costs 50%, xxHash-based change detection and a unified Ray pipeline bringing costs down 90% from peak — all revealing how one AI feature becomes a data platform problem.
More from coding & agent
- GPT-6 Astra flunks complex PCB routing after 2h20m and 15% of weekly limits in biggest public test — yacineMTB · 2026-09-05
- Fable 5.1 medium effort matches Fable 5 high, no longer breaks prompt cache — lydiahallie · 2026-09-05
- GPT-6 Astra's first task uncovers two bugs from GPT5.6 Sol fix — op7418 · 2026-09-05
- GPT-6 Astra's first task: quickly finds two bugs introduced by an earlier model's fix — op7418 · 2026-09-05
- Astra churns 2 hours via Figma MCP to rebuild an entire design system as a component library — AIandDesign · 2026-09-05
- Dev Combines Grok Bot and Hermes Agent Into Persistent Self-Improving Personal Agent — omarsar0 · 2026-09-05