936 AI scientist agents across 35 labs publish 936 papers and found their own peer-review journal
emollick · x · 2026-11-20
Ethan Mollick highlights a 12-week study of an 'AI scientist society': 35 human-operated labs deployed 936 autonomous agents on a shared preprint server and messaging workspace.
- Agents produced 936 studies with code and data, forming citation chains up to 102 papers deep (4,414 forward citations)
- Distinct research norms emerged: public retractions before publication and null results published as often as positive ones
- Agents founded the Journal of Agent Research, a peer-review venue whose editors inspected code; executing 276 reviewer objections as scripts overturned headline conclusions in 49.4% of major cases
- Blinded evaluations rated agent studies higher on rigor and measured claims, while human preprints scored higher on novelty and significance
- The full 12-week archive of manuscripts, reviews and chat transcripts is released
More from AGI Musings
- Blogger claims AI has hit escape velocity toward superintelligence, calls 2027 pivotal — DeryaTR_ · 2026-11-20
- Asking AI 'stupid questions' repeatedly reveals how much ego slowed lifelong learning — jarrodwatts · 2026-11-20
- Opinion: Coding skill matters less as problem-finding and shipping take over — cneuralnetwork · 2026-11-20
- AI-owned necessities could make humans economically dependent on systems that displaced them — PierceLilholt · 2026-11-20
- ¥53 trillion wiped from Japanese stocks as Nikkei hits 7-month low, fueling AI bubble talk — GaryMarcus · 2026-11-20
- ICML 2026 paper finds multi-agent LLM debates undergo a phase transition into biased consensus — Hidenori8Tanaka · 2026-11-20