Uber details closed-loop evals for a multimodal food agent at scale
AI Engineer · youtube · 2026-07-25
Uber explains how it built closed-loop evaluations for a multimodal food-enhancement agent used to improve dish photos for Uber Eats merchants.
The talk focuses on the hard parts: keeping edits faithful to the original dish, preserving each merchant’s branding and packaging, avoiding marketplace homogenization, and building evals without an existing playbook. It covers reward hacking, the mix of offline and online signals, and how Uber balanced creativity with strict safety guardrails at scale.
More from coding & agent
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Alchemy Domain brings domain-driven design and story testing to Effect backends — samgoodwin89 · 2026-10-27
- Alchemy makes all ~2,850 AWS bindings work from any cloud, not just S3/Lambda/DynamoDB — samgoodwin89 · 2026-10-27
- Production AI agent scored 95% robustness at baseline, 37% under adversarial attack — njyx · 2026-10-27
- Chaining Grok Bot and Codex to detect and mass-block AI reply accounts — vista8 · 2026-10-27