Databricks releases AI Extract for processing 500+ page documents and complex nested schemas
matei_zaharia · x · 2026-08-20
Databricks released AI Extract to tackle complex document processing pain points:
- Processing 500+ page documents exceeding 1M tokens
- Handling large, nested schemas with 1k+ objects
- Managing complex schemas requiring frontier reasoning
Technical Implementation:
- In-house custom model trained on complex real-world examples
- Custom agent harness designed for long documents that decomposes, executes in parallel, and reconciles output
This reflects their methodology: identify key workloads, build in-house models + harnesses, and ship via close collaboration.
More from coding & agent
- atuin v18.24 adds cross-device sync to resume AI threads across Claude and Codex — braelyn_ai · 2026-10-16
- Agents turn conservative as context grows: edits shrink from 150 to 30 lines — dbreunig · 2026-10-16
- ai& becomes an official built-in Cline provider with 13 open-weight models — DavidBennett__ · 2026-10-16
- Open-source rizin-mcp lets LLMs run local binary and malware analysis via Rizin — Pure_Emergency1424 · 2026-10-16
- x402 as a free GTM channel: agents discover 100+ tools, no API keys needed — 0xJeff · 2026-10-16
- Sam Altman: stop getting better at prompts, build loops and graphs that prompt for you — goyalshaliniuk · 2026-10-16