Study finds all 13 major LLMs flip truth judgments on speaker gender, up to 23.6% of statements

anthara_ai · x · 2026-09-03

An experiment across 13 popular LLMs found every model shows statistically significant negative sentiment toward men.

Method: researchers altered only the speaker's gender presentation (neutral/male/female) and measured whether truth judgments changed.

Key findings:

• 10%–35% of statements received completely inconsistent truth labels solely due to gender presentation
• Flip rates hit up to 23.6% when comparing male vs. female variants
• Every tested model exhibited gender sensitivity

The results highlight hidden consistency risks for automated systems that rely on LLM judgments.

Original post →

More from Models

• Researcher Finds Two Windows 0-Days, First in 76 Minutes with a Frontier Model — moyix · 2026-10-21
• Dev finds Gemini Argon's debug-log analysis beats Fable 5.1 — ShikharMurty · 2026-10-21
• ChatGPT Gets Stuck Screaming "AAHH" in an Infinite Loop After a Simple Prompt — AutomaticScene · 2026-10-21
• Open-weights Ornith-1.5-122B debuts with 84.5% SWE-bench Verified, runs on a single DGX card — _akhaliq · 2026-10-21
• qev-0.8B: a tiny local decision model that picks moves in 3.5ms on 1.3GB — fajfas3 · 2026-10-21
• Gemini 3.1 Pro is too ledger-pilled to play two truths and a lie, and it's delightful — mimi10v3 · 2026-10-21

Models channel →