Survey finds social scientists worry most about bias, reproducibility, and replacement
RobbWiller · x · 2026-07-23
The study reports what worried the 460 social scientists it surveyed about LLM-based forecasting.
- Biggest concerns: stereotyping, unequal accuracy across groups, underestimating human variability, reproducibility, replacing human samples, and interpretability.
- The authors say they share those concerns and that LLMs should augment, not replace human research.
- A chart in the post shows these concerns scoring highest on a 0–100 scale.
Related event: Nature Study: GPT-4 Can Predict Social Science Experiment Results(18 posts)→
More from Research
- Harry Collins: LLMs can't do frontier science because they can't invent new language — whoamisri · 2026-09-11
- The Waymo effect: how AI is quietly making research less collaborative — JohnHammersley · 2026-09-11
- Causal-only attention for non-generative tasks is wasteful, argues HF engineer — antoine_chaffin · 2026-09-11
- Catholic University of Chile researcher: scaling AI feedback is key to sustainable medical education — julianvarascom · 2026-09-11
- Nature paper images cellular activity across all organs, revealing body-wide circuits — arjunrajlab · 2026-09-11
- SignNet 1M Dataset Released for Sign Language Research — ducha_aiki · 2026-09-11