Databricks exec: AI inference stack security is turtles all the way down
pwendell · x · 2026-11-23
Databricks exec pwendell warns that the modern AI inference stack is "turtles all the way down" security-wise: a breach at any layer breaks everything above, so companies must vet the full token supply chain down to physical hardware. He cites sloppy practices at every layer — top neoclouds lacking basic tenant-isolation knowledge, inference providers "accidentally" disabling ZDR or making its config unusable — and explains Databricks is entering inference with novel tenant-isolation primitives and vertical integration, having found only a single neocloud robust enough to run customer workloads.
More from Infra
- Ex-Goldman CEO Blankfein: AI Is Now Disrupting the Earnings-Stock Price Relationship — firstadopter · 2026-11-23
- VoiceShelf ships on Android: offline Kokoro TTS hits 45x realtime via custom NPU runtime — Simple-Lecture2932 · 2026-11-23
- Databricks exec: inference providers routinely botch ZDR commitments — pwendell · 2026-11-23
- Cerebras CEO: architecture choices sidestep HBM, CoWoS and TSMC 3nm bottlenecks — rohanpaul_ai · 2026-11-23
- Open-source Kapitsa hits 960+ tok/s prefill on M5 Max with 4-bit Hy4-flash — 0zyman23 · 2026-11-23
- Alabama Power to cut rates $160M thanks to data center revenue — binarybits · 2026-11-23