Ex-Microsoft Spark PM joins Databricks, makes the case for its Lakehouse in 36-minute deep dive
adnan_hashmi · x · 2026-11-04
Miles Cole, a new Staff PM at Databricks and former Microsoft product-side engineer for Spark and Delta Lake, published a 36-minute deep dive on why the lakehouse architecture is best realized on Databricks.
He frames the lakehouse as unifying warehouse-grade data management with the openness, flexibility and decoupled storage of the data lake, and argues Databricks' edge on three points:
- Robust data management comes standard
- Flexibility without the complexity
- A track record of innovation
The post scopes itself to capabilities unique to Databricks rather than a generic multi-platform comparison.
More from Infra
- Intel may discontinue Arc B580 to prioritize higher-margin Arc Pro cards as B70 prices rise — chemist_slime · 2026-11-04
- Altman: I've long argued the world should ramp up memory production — sama · 2026-11-04
- US can't build enough data centers while China can't fill the ones it has with chips — zijing_wu · 2026-11-04
- 29 to 1: Data center restriction ballot measures dominate across the US — 4KTV · 2026-11-04
- Why Musk capped Grok Bot: $15/hr GPU spot market vs $4/hr TCO funds $400B compute plan — AccBalanced · 2026-11-04
- US datacenter buildout stalls while Paraguay and Kazakhstan scoop up AI compute — ivan_bezdomny · 2026-11-04