First INT4 model lands in int8-vllm: 4x used MI100 hits 222 tok/s decode

1ncehost · reddit · 2026-11-22

Original post →

More from Infra

Infra channel →