Daytona Benchmarks NVIDIA Vera CPU on Agentic Workloads, Cited in Official Blog
mattturck · x · 2026-09-17
Daytona spent five days at NVIDIA HQ testing the new Vera CPU on agentic workloads, earning a citation in NVIDIA's official blog alongside Perplexity, ClickHouse and DeepInfra.
- Vera shows serious gains for agentic execution, with memory bandwidth above traditional server CPUs
- Wide SVE2 vector units with native FP8 make NumPy-heavy code fly
- Agent sessions accumulate hundreds of thousands of input tokens — stateful, long-running, CPU-heavy — matching Vera's design
Context from the AI Infra Summit (8,000+ attendees, up from 3,500): Amazon Annapurna's NVHBM custom HBM, d-Matrix pairing Vera CPUs with Raptor XPUs via NVLink Fusion, Lambda's 23% perf-per-watt gain with DSX MaxLPS, and Pinterest using Blackwell + Dynamo for visual discovery — all under the theme of optimizing tokens per watt for AI factories.
More from Infra
- To dethrone Postgres, new databases must prioritize ecosystem integrations from day one — mgill25 · 2026-11-02
- ESP32-powered 4-inch touchscreen builds a TUI dashboard for monitoring a DGX inference cluster — CATLLM · 2026-11-02
- OpenRouter crosses 10 quadrillion annualized token run rate, doubling every 10.5 weeks — deedydas · 2026-11-02
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02