6,000 fruit picks: ChatGPT's "random" choice changes sharply by language
Raffallos · reddit · 2026-08-24
A developer asked GPT-5.6-Luna to randomly pick a fruit from a 10-item list 6,000 times each in English, Polish, and Japanese. Despite identical wording and fruit order, only four fruits were ever picked across all three languages.
A second run of 6,000 trials with the fruit list shuffled each time showed slightly better—but still only three—fruits selected. Full write-up, GitHub methodology, and the raw dataset on Hugging Face are linked.
More from Models
- Muse Spark vs Qwen and GLM: US open models still trail on agentic tasks — zsakib_ · 2026-10-16
- Muse Spark 816B gets llama.cpp support just 30 minutes after release — ngxson · 2026-10-16
- Are the fastest GPU kernels now written by AI? Kernels are hyper-verifiable, argues one dev — fleetwood___ · 2026-10-16
- Scale AI launches muse spark open: 816B-param MoE with 1M context, billed as top US open-weight model — jiayi_pirate · 2026-10-16
- NVIDIA HF listing for Qwen3.8-Flash-Next-FP4-Local leaks unannounced Qwen3.8 model — TheZachMueller · 2026-10-16
- Muse Spark Open, billed as the most capable US open-weight model, lands on Nebius day one — Arindam_1729 · 2026-10-16