LLMs may develop hiring bias from experience, not just training data
MIT Tech Review AI · rss · 2026-07-20
A new study suggests that LLMs may be more likely than humans to form hiring biases.
Researchers at Princeton and the University of Chicago ran models such as ChatGPT, Claude, and Gemini through a simulated hiring game based on a psychology experiment. The models were asked to maximize successful hires across 40 rounds, but all candidates were equally likely to succeed. Despite that, the models quickly started to segregate candidates by fictional ethnic group into different job niches after limited experience.
Key findings:
- The models showed stronger stereotyping than humans from the original study; on the segregation scale, human participants scored 0.84, while the models were about 65% higher, with OpenAI’s o3 at 1.83, close to the maximum.
- Newer reasoning models, including o3 and DeepSeek R1, showed even stronger bias.
- Simply telling the models to be fair had little effect.
- Adding a bonus for diverse hiring reduced bias a lot.
- Giving the models more relevant personal information about candidates also reduced stereotyping, while irrelevant details did not.
The article argues this matters for real-world uses like résumé screening, hiring, loans, and parole: as systems gain memory and experience, they may learn biased shortcuts on their own, not just inherit human prejudice.
More from Research
- VidMap uses RoMa coarse matching on all frames, fine-scale only for keyframes — ducha_aiki · 2026-09-11
- Bug Hunt Bench author: leaderboard noise is about 2-3 points — PawelHuryn · 2026-09-11
- PNAS paper shows a tiny billiard-ball system is a universal computer — undecidability lives in two dimensions — eigensteve · 2026-09-11
- New paper: Absolute pose estimation from affine cues and gravity direction — ducha_aiki · 2026-09-11
- LoMa Paper Ships REALLY HardPairs Dataset, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11