Lack of training data limits AI's ability to ask good questions

tobyordoxford · x · 2026-08-23

The author points out that a key issue is the lack of good training data (or a verifiable reward) for asking good questions. Unless this skill comes for free during pretraining on math texts or while learning to prove statements, it is hard to see why models would possess it.

Related event: Toby Ord: AI Is Automating Proof, but Asking the Right Questions Remains Human Territory(7 posts)→

Original post →

More from AGI Musings

AGI Musings channel →