ICML: Correcting Systematic Bias in LLM-as-Judge Evaluations
Kangwook_Lee · x · 2026-07-06
Researchers presented "LLM-as-a-Judge Corrected" at ICML to correct systematic biases when using LLMs as evaluators, aiming to improve the reliability of automated evaluations for agents and models. This collaborative work by Kangwook Lee's group addresses known limitations in current LLM-as-Judge evaluation frameworks.
More from Research
- Datology webinar: Curation Studio matched top data baselines with under 20% compute — josh_wills · 2026-10-27
- KANLab: an interactive browser playground for Kolmogorov-Arnold Networks — Lukas Niehaus · 2026-10-27
- CMU's LLM2Cert synthesizes stability certificates verified via SMT and Lean — CarnegieMellonU · 2026-10-27
- NVIDIA open-sources FLORA, a robotics data engine ~125x cheaper than GPT-6 Astra — nvidia · 2026-10-27
- RSNA 2026 Deep Learning Labs return: eight hands-on AI classes over four days in Chicago — PRouzrokh · 2026-10-27
- Steering two orthogonal concept neurons makes a model compose "gnome" — Sauers_ · 2026-10-27