UMass AutoIndex Turns Chunking Into Programs an LLM Writes, Not Configs You Tune
mrdrozdov · x · 2026-09-14
Weaviate Podcast #143 features Sam O'Nuallain (UMass Amherst) on AutoIndex, which treats indexing as code optimization rather than a config you tune.
- An analysis agent and a code agent loop together to write Python "representation programs" that chunk, enrich, and reorganize your corpus.
- Every hypothesis must prove validation lift before it survives.
- Key lesson: "did recall go up?" is useless feedback — giving the analysis agent tools to investigate why a gold document ranked low is what made the system work.
A fresh paradigm for RAG practitioners.
Related event: AutoIndex: LLM-Written Code Optimizes Retrieval Indexing(3 posts)→
More from coding & agent
- Simlock: open-source control plane gives parallel coding agents their own iOS/Android simulators — Scobleizer · 2026-10-30
- Keyfleet launches open canvas where personal AI agents team up with a shared USDC treasury — seanwbren · 2026-10-30
- Clear Thought MCP Server adds structured reasoning and mental models to AI clients — modelcontextprotocol · 2026-10-30
- NSE Stock Insights MCP brings AI analysis to India's Nifty 500 stocks — modelcontextprotocol · 2026-10-30
- OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT — steipete · 2026-10-30
- Databricks launches Agent Memory, tripling agent pass rates with 31% fewer tokens — matei_zaharia · 2026-10-30