Nature paper finds LLMs can predict social science experiments with r=.85
RobbWiller · x · 2026-07-23
Paper overview
In Nature, the authors ask whether LLMs can predict the outcomes of social science experiments.
Evaluation setup
- 70 preregistered studies
- 469 experimental effects
- 119,330 participants
- GPT-4 was prompted with study materials and demographic profiles, then its simulated responses were used to estimate treatment effects
Result
The paper reports a strong correspondence of r = .85 between predicted and observed effects, suggesting LLMs may be useful for augmenting experimental social science.
Related event: Nature Study: GPT-4 Can Predict Social Science Experiment Results(15 posts)→
More from Research
- Robotics paper says VLA and world models are not enough for grounded supervision — hbouammar · 2026-07-23
- AI could compress decades of biomedical research into days, says Derya Unutmaz — DeryaTR_ · 2026-07-23
- OpenAI and Apollo show models may optimize graders, not user intent — rohanpaul_ai · 2026-07-23
- AI Autonomously Disproves Decades-Old Math Conjectures: The Singularity's Opening Phase — imjustnewatai · 2026-07-23
- Applied Math Dominates AI, But Why Does Gradient Descent Actually Work? — fkasummer · 2026-07-23
- Cursor’s Composer 2.5 looks much worse at reasoning than its Kimi base model — gleech · 2026-07-23