Developers now deploying 1T-parameter models on their own infrastructure
dejavucoder · x · 2026-10-23
Developer @dejavucoder posts that it's now "deploying season" for 1-trillion-parameter models on self-built infrastructure, suggesting teams are running trillion-param LLMs on their own compute stacks.
More from Infra
- Virtual Head Attention: 4x smaller KV cache, beats GQA on long context (RULER 84.4 vs 73.0) — pmttyji · 2026-10-23
- NVIDIA ships Nemotron 3.5 Bolt E4B, an open vision model that runs on 6GB RAM — danielhanchen · 2026-10-23
- TensorSharp hits 4.4–5.5x llama.cpp prefill throughput on DeepSeek V4.1 Flash with 5x A40 — fuzhongkai · 2026-10-23
- SauerkrautLM-MoEdernColBERT: tiny 1.5M-115M MoE late-interaction retrievers, Apache 2.0 — QuixiAI · 2026-10-23
- Amazon CEO Andy Jassy: $220B capex still can't meet AI demand, AWS eyes $1T run-rate — a16z · 2026-10-23
- 2-bit quantized DeepSeek 4.1 Flash tested locally: KDL degrades but still works — bakawolf123 · 2026-10-23