After 3 days at an AI-Talmud workshop: how do you eval AI where experts disagree?
EhudReiter · x · 2026-10-09
Ehud Reiter reports from a 3-day workshop on AI and Rabbinic/Talmudic studies, highlighting a hard eval question: how to evaluate AI answers in domains where human experts hold quite different opinions.
More from AGI Musings
- Ex-UK AISI comms officer goes independent and questions why AI companies don't act on their own warnings — AaronBergman18 · 2026-10-09
- Why hard workers hate AI: fear of a 'Brahmin caste' of Idea Guys — menhguin · 2026-10-09
- Prediction: frontier models as real-time robot policies at 10k-100k tok/s within 1-2 years — ATTlKA · 2026-10-09
- AI won't take all jobs soon: replacement needs scarce, costly human specialists — boxenluder · 2026-10-09
- Mathematician: Terence Tao's strategy assumes AI never explains math better — burny_tech · 2026-10-09
- Verifiable vs non-verifiable is the wrong lens; slow-to-verify is the real bottleneck — rosstaylor90 · 2026-10-09