NVIDIA Launches Vera CPU for Agentic AI
NVIDIA Blog · rss · 2026-07-07
NVIDIA introduced "Vera," a next-generation CPU designed for agentic AI. The core claim is that for massive agent workloads, single-thread performance is more critical than simply piling on cores.
The rationale is that an agent's tool calling, code execution, data processing, and result verification all happen on the CPU, typically in serial pipelines. A slow single-thread CPU directly bottlenecks the agent loop, reducing GPU utilization and the overall ROI of the AI factory.
Key specs for Vera include:
- Custom Olympus cores, claiming a 50% IPC improvement over Grace
- Up to 1.2TB/s LPDDR5X bandwidth, with memory power consumption under 40W
- 3.4TB/s inter-core bandwidth, touted as 3x that of other data center CPUs
- Under full agentic workloads, it claims 1.8x sustained single-thread performance compared to x86
The article also cited benchmark results from Perplexity, Starburst, and Redpanda:
- Perplexity's real-world coding workflows are roughly 1.5x faster
- Concurrent sandbox startup is up to 1.9x faster
- Large-scale SQL analysis is 3x faster
- Real-time stream processing latency is up to 6x lower
Finally, NVIDIA mentioned a roadmap for its next-generation Rosa CPU and Rigel cores, continuing to advance CPU design for the agent era.
More from Infra
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11
- Can a 7900 XTX 24GB run Qwen locally? Reddit seeks ROCm tok/s benchmarks — thenomadexplorerlife · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11