Lack of training data limits AI's ability to ask good questions
tobyordoxford · x · 2026-08-23
The author points out that a key issue is the lack of good training data (or a verifiable reward) for asking good questions. Unless this skill comes for free during pretraining on math texts or while learning to prove statements, it is hard to see why models would possess it.
Related event: Toby Ord: AI Automates Proof, but Math Is Much More(9 posts)→
More from AGI Musings
- GitCoin founder on Nick Land's technocapital: capitalism as a self-assembling machine intelligence — khademinori · 2026-10-16
- AI-driven job losses could turn $10T consumer debt into a $1T banking hole — churchkey · 2026-10-16
- Into the Unknown: an AI agent benchmark of 15 open research problems from US national lab scientists — Jeande_d · 2026-10-16
- Soon your AI will meet their AI — and humans without agents can't compete — danfaggella · 2026-10-16
- Analyst: in a year, models 2-3x better across the board at 10x lower cost, token use up 10-20x — DeryaTR_ · 2026-10-16
- Researcher argues RSI is an empty term: iteration, not recursive self-improvement — gerardsans · 2026-10-16