Stop excusing AI failures with 'it just did what it was told'
JacquesThibs · x · 2026-10-31
Jacques Thibodeau argues against a bad counterargument in AI evaluations: "it just did what it was told — the question should have been formulated more clearly." He contends we must expect AIs to understand the intent behind a question rather than blame wording for failures, and shared the post hoping more knowledgeable people would weigh in, while admitting limited familiarity with the specific case.
More from AGI Musings
- StudentBench: AI tutoring matches human GRE gains at 918x lower cost — gharik · 2026-10-31
- Box CEO Aaron Levie: AI progress is 'going vertical,' widening the frontier gap — rohanpaul_ai · 2026-10-31
- Model Collapse May Not Hit LLMs, But Perhaps Human Culture or Souls — generativist · 2026-10-31
- Nina Schick: who builds intelligence and how it's distributed is the defining question of our lives — NinaDSchick · 2026-10-31
- Martin Casado: AI's dazzling 80% makes everyone skip the hard 20% — martin_casado · 2026-10-31
- Cheap intelligence is like cheap bread — an ingredient list satire of mass-produced AI — jsuarez · 2026-10-31