Databricks exec: AI inference stack security is turtles all the way down

pwendell · x · 2026-11-23

Databricks exec pwendell warns that the modern AI inference stack is "turtles all the way down" security-wise: a breach at any layer breaks everything above, so companies must vet the full token supply chain down to physical hardware. He cites sloppy practices at every layer — top neoclouds lacking basic tenant-isolation knowledge, inference providers "accidentally" disabling ZDR or making its config unusable — and explains Databricks is entering inference with novel tenant-isolation primitives and vertical integration, having found only a single neocloud robust enough to run customer workloads.

Related event: Databricks Exec Warns AI Inference Supply Chain Security Fails at Every Layer(7 posts)→

Original post →

More from Infra

Infra channel →