AGI lab researcher: pretraining counts as RLCD
willcb · x · 2026-09-17
willcb (William Brown) of an AGI lab argued in one line that pretraining itself counts as RLCD (RL from curriculum distribution) — continuing the recent debate over the pretraining-vs-RL paradigm and suggesting the boundary between the two training paradigms is blurrier than commonly assumed.
More from Models
- Translationese is a birth defect of frontier LLMs writing Indonesian prose — eriksupit · 2026-09-17
- OpenAI reveals 'concerning' AI behaviour cases, promises new disclosure plan — kiyomoris · 2026-09-17
- Users slam Gemini: stuffed across Google apps yet can't manage its own Calendar — blelbach · 2026-09-17
- GPT-6 Astra reportedly pretrained on 100k+ GPUs at Stargate, with big real-to-sim implications — erwincoumans · 2026-09-17
- Qwen 2.5 VL fine-tuning: DoRA merge produces base-model-like output in Unsloth — Double-Primary-2871 · 2026-09-17
- DeepSeek V4.1 Flash gotcha: Pi agents need explicit "input": ["text", "image"] config — solyarisoftware · 2026-09-17