Microsoft's decision model promised 80ms, serves 300ms via OpenRouter

DotaMate · reddit · 2026-10-11

A Reddit post calls out Microsoft's decision model for promising 80ms latency while actually serving 300ms through OpenRouter, losing to other open-source decision models. Screenshots show drex 1.5 9b leading the sub-10B decision index with the lowest latency on OpenRouter. The author also questions whether anyone needs these Jev-like decision models at all—a third-party evaluation dispute over claimed vs. real-world model latency.

Original post →

More from Models

Models channel →