How Matei Zaharia went from Berkeley PhD and Spark to a $190B Databricks
jfiance · x · 2026-10-02
- Spark origins: Matei Zaharia started Apache Spark as a PhD project at Berkeley in 2009; it became one of the most widely used open-source systems for large-scale data processing.
- Databricks: He and fellow researchers spun the tech into Databricks, now valued at $190B, where he remains co-founder/CTO while maintaining MLflow and Delta Lake.
- Back to campus and agents: He's also an Associate Professor at Berkeley EECS, researching reliable agent scaling and co-authoring open-source projects DSPy and GEPA, which auto-optimize prompts and models.
- Honors: Awarded the 2025 ACM Prize in Computing; his Spark dissertation won ACM's Doctoral Dissertation Award in 2014 — a neat bookend illustrating Berkeley's startup flywheel.
Related event: From Spark to Databricks: Matei Zaharia's Berkeley Startup Journey(2 posts)→
More from Companies & People
- Luiza Jarovsky taunts Uber: maybe hire back the 3,300 people AI replaced? — LuizaJarovsky · 2026-10-02
- IIT Madras CeRAI to host AI Governance 2026 conclave on AI measurement — ravi_iitm · 2026-10-02
- Work trials are the future of AI hiring— but how do employed candidates actually do them? — MxMnr · 2026-10-02
- Team of <10 builds near-zero-maintenance personal apps on Debian 13 via coding agents — joshalbrecht · 2026-10-02
- WSJ: OpenAI parts ways with 3 safety researchers over mishandled sensitive info — TechCrunch AI · 2026-10-02
- Synopsys investor day shows agentic EDA agents multiply tool usage and unlock new pricing paths — BenBajarin · 2026-10-02