Uncensored 249GB DeepSeek V4.1 Flash runs on a single Colab GPU at 118 tok/s
Healthy_Essay3388 · reddit · 2026-10-31
A Reddit user open-sourced a setup that runs the uncensored 248.8 GB DeepSeek V4.1 Flash on a single Google Colab GPU (96 GB VRAM), hitting 118.7 tok/s on average (122.2 best) via quantization/offloading.
One command spins it up as an OpenAI-compatible endpoint with no server needed — it runs on the 200 monthly compute units included in a Google AI Pro subscription. Repo: github.com/leonxger/deepseek-colab.
More from Infra
- Sam Altman: local inference is a 'terrible allocation' of scarce DRAM, sparking debate — mmitchell_ai · 2026-10-31
- Dev publishes FLARE-based Qwen 3.8 Flash Next images with 1M context for RTX 6000 PRO — johannes_bertens · 2026-10-31
- AI spending spree deepens free cash flow holes; Microsoft stays positive via $25B bond offering — Kr00ney · 2026-10-31
- Google Cloud spend caps go GA with API, live cost reports and automatic monthly resets — rseroter · 2026-10-31
- Swift 1.5 Flash Next Heretic quants add IQ4_XS and IQ3_S tuned for reverse engineering — jjusko20 · 2026-10-31
- ClickHouse discloses unauthenticated RCE vulnerability CVE-2026-116366, patches available — Hacubu · 2026-10-31