Pre-training keeps evolving and will still need humans in the loop for data review
himanshustwts · x · 2026-11-07
Practitioner himanshustwts shares his assumption that pre-training will keep evolving — both in new architectures and updated recipes — and will still require human-in-the-loop review, given how much data there is to filter and stage.
More from Models
- Prominent user vents over OpenAI's repeated GPT 6.2 delays: 'What the heck is going on?' — mark_k · 2026-11-07
- Only 7 AI products rank top on web, mobile and revenue — Perplexity is one, a16z Top 50 shows — ChrisUniverse · 2026-11-07
- Arena weekly: Kimi K3.1 Pro tops open models, Gemini leads video, GPT Image 2x faster — arena · 2026-11-07
- MiniMax and Fireworks to host SF fireside on building M3.1 Flash for long-running agents — MiniMax_AI · 2026-11-07
- Pre-training ladder trick: test every recipe change on 300M–6B models first — teortaxesTex · 2026-11-07
- 'Hidden GPT-6.2 Astra' claim debunked: fake reveal tricked via one-line console object — teortaxesTex · 2026-11-07