AutoIndex treats RAG indexing as code optimization — LLM agents write your chunking programs
CShorten30 · x · 2026-09-07
The Weaviate Podcast #143 features Sam O'Nuallain (UMass Amherst) on AutoIndex, which reframes corpus indexing as a code optimization problem.
- Core idea: chunking isn't a config you tune — an analysis agent and a code agent loop together to write Python "representation programs" that chunk, enrich, and reorganize your corpus.
- Every hypothesis must prove validation lift before it survives.
- Biggest lesson: "did recall go up?" is useless feedback. Giving the analysis agent tools to investigate why a gold document ranked low is what made the system work.
Related event: AutoIndex: LLMs Write Code to Automatically Optimize RAG Indexing(7 posts)→
More from coding & agent
- WanGP adds one-click AMD GPU support for Tencent's Hy-Nomas world model, runs on 8GB VRAM — cocktailpeanut · 2026-10-27
- He benchmarks new models by having them build their own copilot — $28 of compute — bucolucas · 2026-10-27
- Founder generates 46 app promo videos in 4 days with Claude, skipping $11,500 in UGC fees — PrajwalTomar_ · 2026-10-27
- Should agents be allowed to change plans mid-task? Reddit debates the drift boundary — wistfulcracker84 · 2026-10-27
- HeyGen + Canva MCP turns slide speaker notes into an avatar presentation video — HeyGen · 2026-10-27
- Local beats cloud: Qwen 3.8 FN handles private student data as well as frontier models — dr_lm · 2026-10-27