Nature Study: GPT-4 Predicts Social Science Experiment Outcomes with High Accuracy
RobbWiller · x · 2026-07-24
A new study published in Nature reveals that Large Language Models (LLMs) like GPT-4 can highly accurately predict the results of social science experiments.
Across 70 preregistered studies, there is a strong correspondence (r=0.85) between LLM-predicted and observed effects. Notably, for unpublished studies outside its training data, the LLM still performs similarly to human forecasters. Furthermore, combining LLM predictions with human predictions increases overall accuracy.
Related event: Nature Study: GPT-4 Can Predict Social Science Experiment Results(18 posts)→
More from AGI Musings
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- Researcher's SkyNews interview: deeply concerned about AI-driven inequality and power — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11
- Anthropic Insiders: Not Everyone at the Lab Believes in High p(doom) — anpaure · 2026-09-11
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11
- AI companionship dissolves the friction real intimacy needs, warns long-form thread — YogeshMalik · 2026-09-11