Empirical AI Papers: Reporting LLM Bias Without Human Baselines
JeremyNguyenPhD · x · 2026-07-04
The author points out a current trend in empirical AI papers: they report on LLM biases without mentioning that human biases in the same areas typically test higher, yet the titles still sensationalize the findings as "shocking AI bias." This serves as a critique of the methodological choices and narrative biases in LLM bias evaluations.
More from Research
- Alex Townsend posts 200 open problems in numerical linear algebra for humans and AI agents — IgorCarron · 2026-09-11
- Navier-Stokes, Riemann, P vs NP: what this week's math buzzwords mean for you — koltregaskes · 2026-09-11
- Fruit fly brain as an LLM: connectome-driven language model demo goes live — ngxson · 2026-09-11
- Harry Collins: LLMs can't do frontier science because they can't invent new language — whoamisri · 2026-09-11
- The Waymo effect: how AI is quietly making research less collaborative — JohnHammersley · 2026-09-11
- Causal-only attention for non-generative tasks is wasteful, argues HF engineer — antoine_chaffin · 2026-09-11