Startup Navi scores 73.3% on OfficeQA Pro, beating frontier labs on same model
ycombinator · x · 2026-11-13
Startup Navi announced it scored 73.3% on Databricks/Mosaic's OfficeQA Pro V2 benchmark, which tests grounded reasoning across 120,000 pages of financial documents. The next-best result was 63.3% using the same Opus 5.5 model, meaning Navi's system beats frontier AI labs by 10 points on identical underlying models.
More from Models
- Dev trains 46M-param native Luganda model Pearl Chat, still collapses after 2 turns — weskambale · 2026-11-13
- RWE-Bench: Fable 5.2 leads engineering tasks at 62%, over double Opus 5.5 — Jsevillamol · 2026-11-13
- Unsloth ships GGUF quant of Inkling-2-Small for local inference — gnukeith · 2026-11-13
- User says Claude banned his account over nationality, verification appeal failed — Haunting-Hand1007 · 2026-11-13
- Open-source Claude Code skill: Opus plans, cheap models build, up to 49% cheaper — Apprehensive_Sky5123 · 2026-11-13
- OpenSearch's first 600M dense embedding model beats its Qwen3 base on MTEB — tomaarsen · 2026-11-13