Geek Test: Running a 122B Parameter LLM on an Obsolete Laptop
_TheGreatDreamer_ · reddit · 2026-08-13
A hardcore developer successfully ran a massive 122 billion parameter Qwen model on an obsolete laptop, predating the LLM era, purely for testing purposes.
Although constrained by the hardware, the model took 5 minutes to load, 2 minutes to process the prompt, and 14 minutes to generate a response. However, this extreme test proves the powerful advancements in quantization and inference tools like llama.cpp—showing that running ultra-large models locally is no longer an absolute physical impossibility, even on extremely weak hardware.
More from Infra
- Tencent squeezes 770B-parameter Hunyuan Hy4 Preview into 214 GiB at ~2.38 bits per weight — coolmum18 · 2026-10-16
- TokenSpeed MLA 2 hits NVIDIA Vera Rubin: up to 3.44x faster decode vs B200 — zhyncs42 · 2026-10-16
- US vs Chinese hyperscalers: Americans fund and schmooze, Chinese demand your BoM and cap you at 7% margin — jwt0625 · 2026-10-16
- How LiteLLM routes one OpenAI-shaped API across every model provider — Mahmoud_Zalt · 2026-10-16
- OpenAI-Broadcom custom AI chip Jalapeño named a TIME Best Invention of 2026 — itsclivetime · 2026-10-16
- Developer live-runs continual pretraining of a Luganda LLM on Colab, 41% done with loss dropping fast — weskambale · 2026-10-16