Open-source decision model KarpoDecision31B tops DecisionIndex, 6x faster than Gemini
量子位 · wechat · 2026-11-21
QbitAI reports that MachinePulse has open-sourced KarpoDecision31B, a decision model built for high-frequency, low-latency agent judgments, topping the 300-model DecisionIndex leaderboard with a score of 73.9.
- How it works: instead of generating answers token by token, it runs a single forward pass and outputs probabilities for a whole set of options (up to 255 candidates per request), with 2.3% calibration error. It runs on one RTX PRO 6000 with a median response of 94ms over 140k+ requests.
- Benchmarks: solved a 36-task filtering challenge in 2.6s with 100% accuracy (6x faster than Gemini); 64.5x faster than a human and 26x faster than GPT in an ordering game; $0.025 per 1,000 decisions.
- Architecture: a ReadoutHead handles choice/yes-no/score tasks with zero output tokens; BranchAttention shares context across branches (653ms median for 16-63 questions); RLCD training keeps probabilities calibrated and prevents domain overfitting.
- Open toolchain: the team also released karpo-browser, a System1+System2 browser-agent stack (TypeScript framework + KarpoDecision27BAct model + KBB eval set covering 584 sites and 23,075 actions). It hits 89% success on Browserbase Benchmark v2 at 1/13 the cost of the top solution, and plugs into Claude Code or Codex via MCP.
More from coding & agent
- mnemos: a self-curating agent memory plugin for Hermes that fades unused memories — RileyRalmuto · 2026-11-21
- Study: evolutionary LLM search found valid solutions but picked invalid programs in 2 of 3 runs — Unusual-Spot-5846 · 2026-11-21
- Dev routes tool calls through a 421M model at 12ms to catch risky agent actions — looselyhuman · 2026-11-21
- Screen-share + voice via MCP into Claude: a faster UI iteration workflow — Different_Scholar_74 · 2026-11-21
- Tencent & KCL release GroupAssistBench: group-chat agents recall memories but fail to use them — 量子位 · 2026-11-21
- Open-source E2E-encrypted MCP server lets your phone message a local AI agent — uriwa · 2026-11-21