Stanford Professor Critiques Hugging Face Benchmarks; CEO Concedes Flaws

Stanford professor Anshul Kundaje publicly told Hugging Face CEO Clement Delangue that the benchmarks used in its open-source work are deeply flawed and offered better alternatives; Delangue acknowledged the benchmarks do have problems.

2026-10-23 ~ 2026-10-23 · 2 related posts

• Stanford prof Anshul Kundaje publicly calls Hugging Face's open-model benchmarks 'extremely problematic' — anshulkundaje · 2026-10-23
• Hugging Face CEO open to reworking evals after researcher calls its benchmarks 'extremely problematic' — ClementDelangue · 2026-10-23