6,000 fruit picks: ChatGPT's "random" choice changes sharply by language
Raffallos · reddit · 2026-08-24
A developer asked GPT-5.6-Luna to randomly pick a fruit from a 10-item list 6,000 times each in English, Polish, and Japanese. Despite identical wording and fruit order, only four fruits were ever picked across all three languages.
A second run of 6,000 trials with the fruit list shuffled each time showed slightly better—but still only three—fruits selected. Full write-up, GitHub methodology, and the raw dataset on Hugging Face are linked.
More from Models
- Board game eval: Fable underperforms vs Opus 5 — xeophon · 2026-08-25
- Call for Public Release of HF Incident Report; Major Model Releases Expected This Week — sjgadler · 2026-08-25
- Gemini Flash 3.7 observed to yap less but needs hand-holding — A_K_Nain · 2026-08-25
- Apodex 1.1 mini: open 35B local model, harness swap adds up to 10 points — SimonShaoleiDu · 2026-08-25
- Qwen 3.8 27B ranks 9th on Code Arena — tarruda · 2026-08-25
- Thomson Reuters Launches Thomson-1.0 Legal LLM — josh_wills · 2026-08-25