Teaching Qwen 3 4B a new domain via continued pretraining
funJS · reddit · 2026-08-21
The author shares practical experience on teaching Qwen 3 4B to understand a completely new domain (a fictional city) through continued pretraining.
Related event: Hands-On: Continued Pretraining Teaches Qwen New Domains(2 posts)→
More from Research
- QuoteBench: matched scores can hide command-path parsing failures in coding agents — Shangao Li · 2026-08-21
- Lightwheel open-sources EgoSuite-Open100K: 100K hours of egocentric video for robot hands — lukas_m_ziegler · 2026-08-21
- Long-Horizon Agents: Evolution from Seconds to Hours of Autonomous Work — agihouse_org · 2026-08-21
- poolside researchers on turning tens of thousands of data-mix experiments into frontier-moving models — arena · 2026-08-21
- Google open-sources TIPSv2 image-text encoders, SOTA on all four zero-shot segmentation benchmarks — bdsqlsz · 2026-08-21
- Open-source WBC-Mjlab lands on mjswan Cloud: one policy drives G1's whole-body skills in your browser — kevin_zakka · 2026-08-21