Routing spatial AI pipelines across heterogeneous compute: CPU to L40S to H100

PrateekVJoshi · x · 2026-11-18

A practical observation on visual/spatial AI: compute within a single trajectory is heterogeneous — CPU preprocessing, 3D reconstruction on an L40S, world model inference on an H100, rendering on another GPU.

Rather than running the whole pipeline on one expensive machine, route each step to the hardware it actually needs. The gnarly part isn't compute but managing state, data movement, and latency across machines.

Original post →

More from Infra

Infra channel →