Survey finds social scientists worry most about bias, reproducibility, and replacement
RobbWiller · x · 2026-07-23
The study reports what worried the 460 social scientists it surveyed about LLM-based forecasting.
- Biggest concerns: stereotyping, unequal accuracy across groups, underestimating human variability, reproducibility, replacing human samples, and interpretability.
- The authors say they share those concerns and that LLMs should augment, not replace human research.
- A chart in the post shows these concerns scoring highest on a 0–100 scale.
Related event: Nature Study: GPT-4 Can Predict Social Science Experiment Results(15 posts)→
More from Research
- AI could compress decades of biomedical research into days, says Derya Unutmaz — DeryaTR_ · 2026-07-23
- OpenAI and Apollo show models may optimize graders, not user intent — rohanpaul_ai · 2026-07-23
- AI Autonomously Disproves Decades-Old Math Conjectures: The Singularity's Opening Phase — imjustnewatai · 2026-07-23
- Applied Math Dominates AI, But Why Does Gradient Descent Actually Work? — fkasummer · 2026-07-23
- Cursor’s Composer 2.5 looks much worse at reasoning than its Kimi base model — gleech · 2026-07-23
- Lanyon says its neurosymbolic solver is 20–250x faster than frontier models — burny_tech · 2026-07-23