Continued pretraining vs RAG on Qwen 3.5 4B: a hands-on accuracy and performance comparison
funJS · reddit · 2026-09-12
The author ran a controlled experiment comparing a Qwen 3.5 4B model fine-tuned with continued pretraining via Unsloth against a RAG setup on the base model, measuring accuracy and inference performance to quantify the benefit of internalizing knowledge versus on-the-fly retrieval. Full write-up linked in the post.
Related event: Benchmarking Continued Pretraining vs RAG on Qwen 3.5 4B(4 posts)→
More from Research
- Just Action Model: decoupling what separates VLA from world-action models — Yonghao Yu · 2026-10-28
- HABIT-Bench: Best agent memory system scores just 33.61% at inferring user habits — SJTU · 2026-10-28
- CodeCap-Bench: executable code beats natural language as video captions — Jiafu Tang · 2026-10-28
- Omni-InteractScope benchmarks proactive interaction in continuous omnimodal streams — Qwen · 2026-10-28
- Mistral releases Timestral time-series foundation models, tops GIFT-Eval — mistralai · 2026-10-28
- NVIDIA's ThinkWorld learns robot skills from unlabeled human videos via chain-of-dynamics reasoning — nvidia · 2026-10-28