Hugging Face CEO open to reworking evals after researcher calls its benchmarks 'extremely problematic'
ClementDelangue · x · 2026-10-23
Stanford researcher Anshul Kundaje publicly criticized the benchmarks used in Hugging Face's open-source work as "extremely problematic," offering to point to better ones. Hugging Face CEO Clement Delangue replied he's happy to talk and improve. The exchange adds fuel to ongoing community debate about eval quality in domain-specific (especially biology) model work.
Related event: Stanford Professor Critiques Hugging Face Benchmarks; CEO Concedes Flaws(2 posts)→
More from Companies & People
- KU Leuven and VIB open two Group Leader professorships in AI for Biology, start 2027 — jpillowtime · 2026-10-23
- Google's Gemini pretraining team is hiring research engineers in London and MTV — zacharynado · 2026-10-23
- After data and compute, the next picks-and-shovels are talent and physical infrastructure — philhchen · 2026-10-23
- Critics slam Anthropic for rarely defending its work against criticism on Twitter — DKokotajlo · 2026-10-23
- Amazon blocks AI shopping agents while Walmart opens its site to them with spend controls — venturetwins · 2026-10-23
- Commenters speculate Skydance could wire Grok into its entire Hollywood production pipeline — MickeySteamboat · 2026-10-23