VAST Data: the $30B hidden software layer of NVIDIA's AI stack, CEO interview
mattturck · x · 2026-09-25
Investor Matt Turck sits down with VAST Data CEO Renen Hallak. VAST occupies the underappreciated software-infrastructure layer of Jensen Huang's 5-layer AI cake and became a $30B company powering xAI, CoreWeave, Nebius, Mistral and nscale. Topics: day-inference/night-finetune AI factories, the DASE "shared everything" architecture for trillions of vectors, model routing/KV caches/agent memory and permissions, DataEnclave confidential AI, why VAST is profitable when AI infra isn't, whether circular AI financing is systemic risk, scaling from 500PB to 2EB, and "no legal document between us" with NVIDIA.
Related event: VAST Data Builds a $30B Company on the Hidden Infrastructure Layer(2 posts)→
More from Infra
- Meta ships Muse Realtime Avatars, calling real-time videogen infra its hardest problem — ukhndlwl · 2026-09-25
- Goldman Sachs hikes AI power forecasts: 2030 data center capacity raised to 217GW — McDonaghMatthew · 2026-09-25
- Puro-2B: an open recipe trains a Qwen2-1.5B-beating LLM on RTX 5090s for just $4.4K — IgorCarron · 2026-09-25
- YC-backed Prism launches agent-optimized inference cloud, serving DeepSeek V4.1 Flash at 547 tok/s — ycombinator · 2026-09-25
- Google's Suncatcher project aims to put AI data centers in orbit powered by solar energy — The Decoder · 2026-09-25
- Setting up a DGX Spark local inference cluster with 5 role-based Hermes agents — natesiggard · 2026-09-25