RWKV-8 RPU preview hits 12,500+ tokens/s real-time inference

kastnerkyle · x · 2026-11-17

RWKV team shared a preview of RWKV-8 RPU running real-time intelligence at 12,500+ tokens/s. The model is still early, and the team aims to run leading OSS flash models at similar speeds by 2027, with more demos of increasingly larger models coming soon.

Original post →

More from Infra

Infra channel →