Jetson Thor LLM inference hits only ~60% of memory-bandwidth estimate

resrev3R · reddit · 2026-11-19

A Reddit user compared LLM inference on Jetson Thor vs RTX 5070 Ti and found an unexpected gap:

The author assumed memory bandwidth was the main inference bottleneck, but Thor's results suggest another limiting factor, and is asking for explanations.

Original post →

More from Infra

Infra channel →