Dev: Recent models were trained on broken data, saved by orchestration and review loops

willcb · x · 2026-09-24

Developer willcb observes that models from the past couple of years were largely trained on "bullshit broken data," but have recently gotten good enough that you can point them at the data with careful orchestration and review loops to fix most issues—"and now it's kinda fine."

Related event: Developer: Recent Models Trained on Dirty Data, Saved by Review Loops(2 posts)→

Original post →

More from Models

Models channel →