Is T4 Really 170x Slower Than A100?
Future-Structure-296 · reddit · 2026-07-15
While running a point-tracking model, the author found the NVIDIA T4 to be roughly 170x slower than the A100: processing half a video took 0.5 seconds on the A100 and 85 seconds on the T4.
The model settings included: 47 frames, 256×256, batch=1, pure FP32, with an architecture featuring local 4D correlation volume and a transformer for temporal context. The author ruled out common issues like disabled GPUs, models not loaded onto the card, ineffective cudnn.benchmark, and slow performance across two separate T4 machines. They suspect the bottleneck is related to the architecture or operator characteristics and plan to start with profiling to locate the issue.
More from Infra
- NVIDIA publishes Vera CPU architecture details before AMD’s AI event — ryanshrout · 2026-07-22
- oMLX 0.5.2 adds Mac menu-bar stats, low-bit decode kernels, and faster downloads — awnihannun · 2026-07-22
- Strangeworks launches Aura to turn enterprise ops into production optimization systems — whurley · 2026-07-22
- Graph workload 854.graph500 enters SPEC CPU 2026 as a new CPU benchmark — Prof_DavidBader · 2026-07-22
- HilbertRaum open-sources a fully local AI chat and document analysis app for private use — Vladowski · 2026-07-22
- Hybrid and local inference are emerging as a response to AI energy and token costs — dmitry140 · 2026-07-22