NVIDIA Launches Vera CPU for Agentic AI
NVIDIA Blog · rss · 2026-07-07
NVIDIA introduced "Vera," a next-generation CPU designed for agentic AI. The core claim is that for massive agent workloads, single-thread performance is more critical than simply piling on cores.
The rationale is that an agent's tool calling, code execution, data processing, and result verification all happen on the CPU, typically in serial pipelines. A slow single-thread CPU directly bottlenecks the agent loop, reducing GPU utilization and the overall ROI of the AI factory.
Key specs for Vera include:
- Custom Olympus cores, claiming a 50% IPC improvement over Grace
- Up to 1.2TB/s LPDDR5X bandwidth, with memory power consumption under 40W
- 3.4TB/s inter-core bandwidth, touted as 3x that of other data center CPUs
- Under full agentic workloads, it claims 1.8x sustained single-thread performance compared to x86
The article also cited benchmark results from Perplexity, Starburst, and Redpanda:
- Perplexity's real-world coding workflows are roughly 1.5x faster
- Concurrent sandbox startup is up to 1.9x faster
- Large-scale SQL analysis is 3x faster
- Real-time stream processing latency is up to 6x lower
Finally, NVIDIA mentioned a roadmap for its next-generation Rosa CPU and Rigel cores, continuing to advance CPU design for the agent era.
More from Infra
- Engram's random reads don't suit SSDs; CPU-memory over NVLink could serve all 72 GPUs — bookwormengr · 2026-09-11
- 80% of the DIY LLM inference hype posters have already quit — it's brutally hard systems work — abhijithneil · 2026-09-11
- Hugging Face's Ultra Scale Playbook: a free book on training LLMs on GPU clusters — mdancho84 · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11