Jev model flunks probability calibration test, says 60/40 coin is 99/1
Developer JnBrymn found the Jev model assigns a 99/1 distribution to a 60% biased coin, with sweeping scans and prompt-format changes revealing systematic probability calibration failures.
2026-09-19 ~ 2026-09-19 · 2 related posts
- LLM fails coin-flip probability test, says 60/40 coin is 99/1 — JnBrymn · 2026-09-19
- Jev Fails Probability Calibration: Says 99/1 When the Answer Is 60/40 — JnBrymn · 2026-09-19