Ex-Nvidia engineer on company culture and inference infrastructure

Scobleizer · x · 2026-08-28

This interview provides an in-depth look at Nvidia's culture and the intricacies of inference infrastructure. Neil Movva, a former Nvidia intern and current CEO of Sail Research (focused on making tokens cheaper for agents), discusses the company's frugal culture (e.g., employees chipping in for milk) and its incredible retention of top engineering talent. On the technical side, the conversation covers latency vs. throughput tradeoffs, chip pricing, the end of kernel engineering, and the strategy of buying power and chips others ignore.

Original post →

More from Companies & People

Companies & People channel →