Astera Labs' Leo X-Series memory controllers boost long-context inference TTFT by up to 62%
BenBajarin · x · 2026-09-16
Astera Labs expanded its Leo Smart Memory Controller family for agentic AI and cloud workloads. The new Leo X-Series, paired with Scorpio X-Series fabric switches, enables fabric-attached memory for long-context, KV-cache-intensive inference — up to 62% faster time-to-first-token and 22% more tokens per second. Leo 2 E/P series add CPU-attached DDR4/DDR5 expansion with PCIe 6 and CXL 3.2, doubling bandwidth and capacity, plus reliable reuse of legacy DDR4 to cut TCO. Analyst Ben Bajarin highlights the X-series letting GPUs reach more memory without routing KV-cache through the CPU memory subsystem.
More from Infra
- Dev slams agent sandbox pricing as 20x+ the cost of a $6/month always-on VPS — Aryvyo · 2026-09-16
- Signal65 benchmarks NVIDIA Vera CPU at 1.64x per core vs x86 on agentic workloads — ryanshrout · 2026-09-16
- McKinsey: Sovereign AI TAM to hit $500-600B by 2030, 30-40% of AI demand — Beth_Kindig · 2026-09-16
- Intel CEO Lip Bu Tan tells AI Infra Summit: embrace AI, don't fear it — karlfreund · 2026-09-16
- Brad Gerstner: AI buildout hinges on revenue keeping its steep growth curve — markjeffrey · 2026-09-16
- Reported: NVIDIA hardware delivers 40% more throughput at the same power — karlfreund · 2026-09-16