Espresso now auto-optimizes Databricks Spark jobs and configs
mattturck · x · 2026-10-14
benlern announced that Espresso now optimizes Databricks Spark jobs. He notes most Spark jobs run on wrong-sized machines with incorrect configs, causing slow jobs, wasted spend, or both — which Espresso addresses automatically.
More from Infra
- SemiAnalysis teases TPUv7 TCO data: $0.181/M tokens vs $0.222 B200 — firstadopter · 2026-10-14
- Serverless tool calling could slash agent costs 30x by running 1000 agents per sandbox — madhavsinghal_ · 2026-10-14
- Prompt caching kills easy/hard model routing: cached big model now cheaper than small one — Lance_Saul_85 · 2026-10-14
- BofA lifts global memory TAM forecast to $2T by 2030, run rate already over $1T — Beth_Kindig · 2026-10-14
- Ayar Labs, Wiwynn and GUC demo integrated optical compute system with live telemetry at OCP — bookwormengr · 2026-10-14
- AnythingLLM ditches Ollama for Lemonade, shrinking engine from 1.8GB to 137MB — jfowers_amd · 2026-10-14