A tiny site lets you feel local LLM tokens/s before buying the GPU
nypaavsalt · reddit · 2026-10-17
A developer built llmspeed.dev, a small site that estimates how fast a local LLM will run on hardware before you buy the GPU. Built originally for himself and a friend, it's now open-sourced at github.com/nicorobinreal/llmspeed. Note it's an estimate, not exact — real speeds vary per setup.
More from Infra
- DFB lasers headed for LED-style post-scarcity: 1GW global capacity by 2030 — jwt0625 · 2026-10-17
- CoreWeave CEO Calls Stock Sell-Off Irrational as Founders Cash Out $3.3B — GaryMarcus · 2026-10-17
- 96GB+48GB VRAM all-local agent harness owner compares long-horizon models, asks for picks — CharlesStross · 2026-10-17
- Architect founder proposes auction-based exchange to price AI inference like stocks — AccBalanced · 2026-10-17
- ComfyUI MOSS-GGUF already supports FP16 — a one-line fix speeds up older Turing GPUs — fjgcudzwspaper-6312 · 2026-10-17
- Defiance Repack Ships Uncensored Qwen3.8-27B With 40 Switchable Persona Modes — Distinct-Pie2389 · 2026-10-17