Fine-tuning Qwen3.5-9B on a $500 budget: is a P40 24GB enough for QLoRA?
exaknight21 · reddit · 2026-11-02
A developer currently fine-tuning Qwen3.5-9B on an RTX 3060 12GB asks whether a P40 24GB — his only sub-$500 option — can handle QLoRA fine-tuning. He acknowledges the huge Pascal-vs-Ampere gap but wants to avoid cloud rental costs while learning, highlighting the real trade-offs low-budget hobbyists face between old high-VRAM cards and renting.
More from Infra
- KKR, Singtel and Tata put India data center firm STT GDC India up for sale at over $5.5B — HarveenChadha · 2026-11-02
- GPU rental rates crash as supply surges: H100 SXM falls below $2.50/hr on alternative clouds — SumitGup · 2026-11-02
- OpenAI reportedly plans to rebrand data centers as "AI compute campuses" amid public backlash — Polymarket · 2026-11-02
- JetBrains ships Mellum2.1 Thinking MTP head: 1.4–1.8x faster decoding with ~90% draft acceptance — pmttyji · 2026-11-02
- AI demand reshapes supply: Intel shifts CPU capacity to data centers, Korea chip exports up 259% — 创业邦 · 2026-11-02
- Chinese GPU maker MetaX invests in Kuaishou's Kling AI as chip firms turn VCs — 创业邦 · 2026-11-02