kalomaze: the AI training 'flywheel' is diagnostics, not naive training on transcripts

kalomaze · x · 2026-09-09

kalomaze argues the folk model that AI companies 'directly train on user transcripts' is wrong and counterproductive. The real loop: spot humans attempting exotic tasks current evals don't cover → build synthetic constructions covering that problem class → RL on a verifier set designed around the failure. The 'flywheel' is, at heart, diagnostics.

Related event: Navier-Stokes Proof Sparks Data-Leak Controversy, OpenAI Responds(67 posts)→

Original post →

More from Models

Models channel →