Plane AI scores 165/165 on real workspace eval: 18s median latency, $0.10 per answer

JosephJacks_ · x · 2026-11-04

Plane's team significantly upgraded the harness powering its AI, cutting median response time by over 20%, and shared a full real-world eval:

Setup: a workspace for a fictional company with 64 people, 2,560 work items, and 10 projects
Prompts: from simple ("Which urgent Payments items are overdue, and who owns each?") to complex root-cause analysis ("What caused the ledger double-posting incident, and which post-mortem actions remain open?")
Results: 55 questions × 3 runs, Claude Sonnet 5.5 at high effort answered 165/165 correctly (100%)
Cost & speed: 18s median time to answer, $0.10 median cost per answer (the scatter plot shows most answers under 20s/$0.10, with a few complex ones taking 80+s and $0.70+)

The team believes Plane AI will eventually replace search and much of the UI in the product: users ask, and the AI finds or does the work.

More from coding & agent