Debate: one big model is offline RL, specialized models are online RL

willcb · x · 2026-11-17

In a discussion with swyx and PimDeWitte, willcb offers a framing: at the macro level, one big model equals offline RL while specialized models are online RL. He also argues that urging everyone to 'build their own RL envs and tune hyperparameters' — like telling devs to curate agent workspaces and install skills — is anti-AGI-pilled: both are training wheels for toddler AGI that model progress will render obsolete.

Original post →

More from AGI Musings

AGI Musings channel →