ChatGPT's randomness failure: Humans are 4x more random
Pristine_Ad3669 · reddit · 2026-08-21
A comparative study analyzed the randomness of ChatGPT (10,000 trials) vs. humans (6,981 trials) in picking a number between 1-100. Results show humans are 4x closer to true randomness than ChatGPT, with only a 12% deviation from a true RNG compared to ChatGPT's 48%. Specific biases include:
- ChatGPT never picked 1, 5, 20, 50, 70, or 100 in 10,000 tries.
- 29% of its picks ended in 7; it was 6x more likely to pick 47 than random chance.
- Humans most over-picked 69 (2.9x random chance) and 7 (2x), and under-picked numbers containing 3 (e.g., 34, 73).
More from Research
- Retriever: A Framework for Asynchronous, Closed-Loop Robot Agents — ZeYanjie · 2026-08-24
- Converting GMMs ↔ PEFs for fast KLD approximation — FrnkNlsn · 2026-08-24
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- Nature Comment: Provenance, not interpretability, grounds trust in autonomous science — gabepgomes · 2026-08-24
- New Architecture RHEA: Train 1B Model on 8GB VRAM — zemondza · 2026-08-24
- Trained two 16M-param models to do generative CAD with real physics — debreuil · 2026-08-24