Open-weight models are pitched as a security win for large companies
jessi_cata · x · 2026-07-28
A post argues that large companies can run sufficiently capable open-weight models internally, reducing attack surfaces compared with API-based models such as internet exposure, API poisoning, credential risk, and correlated security risk at large labs.
It also quotes a back-of-the-envelope claim that avoiding a $99/month Kimi K3 subscription could justify either a $35,000/month GPU budget or a one-time $500,000 hardware investment, underscoring the economics of internal deployment.
More from Infra
- Kimi K3 runs on AMD MI350X with SGLang and hits 327 tok/s across four requests — burny_tech · 2026-07-28
- Kimi K3 reportedly keeps block attention residuals in a 93-layer design — burny_tech · 2026-07-28
- llama.cpp benchmarks show ROCm and Vulkan trading wins on AMD Radeon AI PRO R9700 — Gesha24 · 2026-07-28
- NASA’s new administrator says SpaceX-backed orbital data centers will happen — elonmusk · 2026-07-28
- Reddit users test whether unlocked CMP 170HX cards can power local AI rigs — Tritheone69 · 2026-07-28
- Dolphin is being trained on Trinity Large Thinking 398B across 72 RTX 4090s — QuixiAI · 2026-07-28