Cohere x Palantir model benchmark mocked online: 670 tokens/s but questionable output

XiRw · reddit · 2026-10-31

A Reddit user criticized the Cohere and Palantir partnership's delivered results as "embarrassing," sharing a benchmark screenshot: the north-mini-code model generating a pelican-on-a-bicycle SVG at up to 670.50 tokens/s using Q8 quantization and F16 KV Cache. The post sparks discussion about the quality-versus-speed tradeoff in the partnership's deployment.

Original post →

More from Models

Models channel →