Tenstorrent hits 5,300 tokens/sec/user decoding gpt-oss-120b on just 8 Galaxy units

DavidBennett__ · x · 2026-11-21

Tenstorrent shared inference results: its Galaxy cluster decodes gpt-oss-120b at 5,300 tokens/sec/user.

Original post →

More from Infra

Infra channel →