Modal benchmarks NVIDIA's Vera CPU: up to 2x x86 throughput on agentic workloads
graceisford · x · 2026-10-21
Modal got its hands on NVIDIA's new Vera CPU and built a benchmark using real-world agentic workloads under contention.
- Early tests show up to 2x the throughput of comparable x86 hardware
- Latency stays low even with hundreds of concurrent workloads competing for resources
- For Modal Sandboxes, this could mean running more agents in parallel without sacrificing latency
More from Infra
- VectorDash Rewrites Windows Search in Rust, Adds Local Reverse Image Search and AI Chat — andy2na · 2026-10-21
- SpaceX earnings: compute buildout beats expectations, capex and debt remain the big risk — JOBhakdi · 2026-10-21
- Enterprise AI data pipelines should start with systems of record, argues Craig Mullins — craigmullins · 2026-10-21
- Musk claims SpaceX will add 200k GPUs monthly, targeting 13GW by 2027 — analysts skeptical — JOBhakdi · 2026-10-21
- SpaceX's AI business beats expectations as Q3 net income hits $4.4B — TechCrunch AI · 2026-10-21
- Together AI Berlin meetup: n8n and NVIDIA engineers on running open models in production — togethercompute · 2026-10-21