CPT Plus RAG Teaches Qwen3.5 4B a Fictional Metro System

A Reddit user combined continued pretraining with RAG on Qwen3.5 4B to teach it a fictional metro map, showing how CPT provides stable domain knowledge while RAG injects dynamic information.

2026-09-16 ~ 2026-09-17 · 3 related posts

• Experiment: continued pretraining for stable domain knowledge, RAG for dynamic data — funJS · 2026-09-16
• Combining Continued Pretraining with RAG: Teaching Qwen 3.5 4B a Fictional Subway Map — funJS · 2026-09-16

1 near-duplicate retellings: funJS