Experiment Wrap: Opus 5.5-Trained 8M Model Generalizes Well but Still Falls Short

Angaisb_ · x · 2026-10-14

Angaisb wrapped up his experiment of having a model train another model. The quoted original post shows Opus produced an 8M-parameter model that already generalizes well (an early checkpoint was shared earlier). In his conclusion he notes that even Opus 5.5 could train a better model, but the results are still not great — though future models may perform better and build bigger, better datasets in a virtuous loop.

Original post →

More from Models

Models channel →