NVIDIA pushes local AI at IFA 2026: 1.9x faster inference, PAIR, RTX Spark PCs
AWS ML Blog · rss · 2026-09-04
NVIDIA, Microsoft and partners announced a slate of local AI updates at IFA 2026:
- Faster inference: llama.cpp gains up to 1.9x throughput on RTX 5090; vLLM is 1.2x on RTX PRO 6000 and up to 1.4x on dual DGX Spark clusters, available via LM Studio and Ollama.
- NVIDIA PAIR: a free, open-source Personal AI Router that discovers compatible PCs on a local network and distributes inference across idle machines.
- One-click local agents: Hermes Agent, OpenClaw (380K+ GitHub stars) and Perplexity Portable Computer will support simplified local model setup on Windows; Portable Computer runs workflows locally and selectively escalates to 15+ frontier cloud models.
- RTX Spark: Lenovo and Acer Windows PCs arrive in October.
- New locally runnable models: Nemotron 3.5 Lightning (30B), GLM-5.3-Flash, Qwen3.8-Flash-Next/27B, LTX 2.5 video, MiniMax-H3 plus FastH3 (4-step distilled, 7x faster), Meta Muse Glimmer (30B), and DeepSeek v4 Flash (284B MoE, 13B active, runs on 2x DGX Spark).
More from Embodied
- Sentdex trains robots to go from lying down to a half kneel, eyeing a full stand — Sentdex · 2026-10-21
- NVIDIA open-sources MotionBricks: 350K motion skills at 15,000 FPS, 2ms latency — aftahi_ai · 2026-10-21
- NVIDIA Cosmos3-H-Dreams: Generative Simulation Brings Clinical Surgery to Life — Hugging Face Blog · 2026-10-21
- FLoTS-SLAM uses optical-flow residuals to hit 0.73 DM-IoU in dynamic monocular SLAM — zhenjun_zhao · 2026-10-21
- Plato ring launches at $199 to turn near-silent speech into AI commands — TinfoilTricorn · 2026-10-21
- Dream-1 controlled 31 unseen robot types across 53 countries within 24 hours — gharik · 2026-10-21