Hands-on: Teaching a local LLM reasoning in new domains via Continued Pretraining with Unsloth
funJS · reddit · 2026-08-21
This post details an experiment using Unsloth to perform Continued Pretraining on the Qwen 3 4B model. The goal was to teach the LLM how to reason about a new domain (a fictional city), demonstrating a practical workflow for injecting specific domain knowledge into local models.
Related event: Tutorial: Teaching Local LLMs New Domains via Continued Pretraining(3 posts)→
More from coding & agent
- Grok Bot Ran a 12-Hour Data Analysis Nonstop, Handling API Rate Limits Itself — Daniel_Farinax · 2026-10-16
- Apple code signing drags for hours; official advice: just wait a week — pjausovec · 2026-10-16
- Hermes: a 4B model with 8K context got worse with more test-time compute, pointing to contextual reasoning — mangahomanga · 2026-10-16
- Flux 3 Klein's Default Templates Are Broken Without Its Prompt Upscaler — StrictMove5839 · 2026-10-16
- 21-person team ships hundreds of PRs weekly with AI writing 97% of the code — rseroter · 2026-10-16
- ClosedMCP: Set Up MCP Servers Once, Share Them Across Your Whole Team — Ok_Sprinkles1301 · 2026-10-16