Gemini 3.8 Flash benchmarked so fast the engineer thought his Slurm job crashed

_lewtun · x · 2026-09-25

Hugging Face engineer Lewis Tunstall praised Google's serving infrastructure: while benchmarking Gemini 3.8 Flash on a new eval, it ran so fast he assumed his Slurm job had crashed — an anecdotal signal of the model's notably low inference latency.

Original post →

More from Infra

Infra channel →