First-timer quantizes DeepSeek 4.1 with ExLlamaV3's EXL3, with an AI copilot

HankYeomans · x · 2026-11-19

A developer shares his first attempt at model quantization: targeting DeepSeek 4.1 using ExLlamaV3's EXL3 quantization. He admits he's inexperienced and the process may be messy, but argues the point is participating hands-on rather than just picking up one of thousands of pre-quantized models.

He also credits Ampcode as a learning partner that keeps asking follow-up questions while helping him build a "brain" and training setup — and notes it's the first AI provider he feels comfortable talking to by voice instead of typing.

Original post →

More from Models

Models channel →