9B model hits 59 tok/s on a 16GB GPU, but tool calls lag at 58% BFCL

AIFlow_ML · x · 2026-11-22

JJ Eaton ran SenseNova-Loop-9B on TensorFold: 59.1 tok/s on an RTX 5070 Ti and 59.5 tok/s on an M5 Ultra, on a 16GB GPU.

Original post →

More from Infra

Infra channel →