GPT-4 predicts 70 social science experiments with r=.85 across 119,330 participants
RobbWiller · x · 2026-07-23
Main finding
LLM-derived effect estimates from simulated participants were highly correlated with observed effects across 70 preregistered social science experiments: r = .85 and adjusted r = .92.
What the paper did
- Built an archive of 70 nationally representative TESS studies plus replications
- Covered 469 effects and 119,330 participants
- Prompted GPT-4 with study materials and demographic profiles, then inferred treatment effects from simulated responses
Key takeaway
The correlations stayed high across a wide range of social-science domains, and the figure shows LLM predictions were broadly comparable to the average expert forecasts.
Related event: Nature Study: GPT-4 Can Predict Social Science Experiment Results(18 posts)→
More from Research
- Nature paper images cellular activity across all organs, revealing body-wide circuits — arjunrajlab · 2026-09-11
- SignNet 1M Dataset Released for Sign Language Research — ducha_aiki · 2026-09-11
- ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
- InFlux++ Method Released — ducha_aiki · 2026-09-11
- Skyfall GS Uses Flux to Refine Gaussian Splatting, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11