Agent Evaluation Science Symposium hits NYC Nov 20, abstracts due Oct 20
yoavartzi · x · 2026-10-14
The Agent Evaluation Science Fall Symposium takes place in New York City on Nov 20, 2026, focusing on how agents should be scientifically evaluated: measurement and benchmark design, reliability, safety, and real-world performance.
- Speakers include Jason Weston, Yoav Artzi, and Nouha Dziri.
- Abstract registration closes Oct 20; submissions due Oct 25 via OpenReview, with poster presentations for accepted work.
- Organizers encourage teams with ICLR agent eval work (especially uncertainty evals) to submit.
Related event: Agent Evaluation Science Symposium Calls for Papers, Deadline Oct 20(2 posts)→
More from coding & agent
- Claude cut a 2.6-hour video export to 20 minutes — but only after being told to rebuild the server — byhewar · 2026-10-23
- 3 flight-booking rules my AI agent checks that I'd never do by hand — Efistoffeles · 2026-10-23
- OpenJet claims Qwen3.8-27B coding runs 1.9x faster than llama.cpp on one RTX 3090 — JeremyCMorgan · 2026-10-23
- Building an autonomous SEO agent in Hermes with three skills: programmatic pages, Keywords Everywhere, DataForSEO — EXM7777 · 2026-10-23
- Building a sports betting AI agent with onchain execution and human approval by default: architecture and lessons — Dry-Comfortable-2678 · 2026-10-23
- How do you audit AI agent decisions in regulated workflows? A field survey — Ok_Way_1993 · 2026-10-23