Ling Tiny 3.0 on a 2017 laptop: 8B model hits 10 tok/s, hints at edge AI future
netherreddit · reddit · 2026-09-26
A Reddit user ran the 8B-parameter Ling 3.0 Tiny with llama.cpp on a 2017 laptop (7th-gen i5, 8GB RAM, no GPU) at 10 tokens/s. In 20 minutes the model completed a multi-turn coding task: writing, running, and iterating on a script that scans a local network for llama.cpp servers. The author argues that 1B active parameters now make useful on-device intelligence possible on nearly any post-2015 hardware, potentially kicking off a new era of edge intelligence with zero new compute.
More from Infra
- Running Qwen2.5-Coder-3B on Android: Jupyter + Pydantic Evals on-device eval pipeline — alex_b3b · 2026-11-11
- 22% of Nvidia revenue now books to Singapore, but only ~1% is local buyers — Gregory_C_Allen · 2026-11-11
- Huawei's Kirin 9050 NPU claims offline 30B MoE on smartphones, +140% perf — AIFlow_ML · 2026-11-11
- Stratechery: Intel vs AMD's diverging earnings and Intel's need for an old-new path — Stratechery · 2026-11-11
- a16z Podcast: Mike Volpi on What the 1990s Internet Boom Teaches Us About the AI Buildout — a16z Podcast · 2026-11-11
- Alibaba files to list chip-design unit T-Head in Hong Kong to fund AI push — pstAsiatech · 2026-11-11