AI chip stacks are still wide open, with memory, networking, and optics left to improve
bookwormengr · x · 2026-07-25
AI chips are still far from settled
The post argues that Nvidia’s architecture is not necessarily the optimal one, and that there is plenty of room for new chip players to innovate at both the physical and logical layers. It cites Chinese AI chip companies as mostly focused on design/logical-layer innovation, with a few exceptions moving toward wafer-scale approaches.
It also points to where the real room for improvement still is: memory access, networking, RAM pooling, and optical interconnects that can move closer to the chip. The underlying claim is that modern LLM stacks are path-dependent on the hardware they were built on, so better architectures may still be waiting to be discovered.
More from Infra
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11
- PyTorch Day Korea 2026 launches first offline conf, CFP closes Sept 13 — PyTorch · 2026-09-11
- Local LLM server dilemma: 4x CMP-170HX (price up 53% in 20 days) vs Mac Studio M5 Ultra — rumboll · 2026-09-11
- llama.cpp lands Flash Attention tuning for RDNA4, big prefill gains on AMD — pmttyji · 2026-09-11