Grok 4.5 tops Ramp’s invoice test on 150,000 real business bills
elonmusk · x · 2026-07-25
Grok 4.5 is being pitched as strong for real-world work after a Ramp benchmark on 150,000 actual business invoices.
- Ramp scored models on whether they predicted every correction a human would make.
- Grok reportedly had the highest perfect-extraction rate, ahead of similarly priced Gemini Flash 3.6, GPT 5.6 Terra, and Sonnet 5.
- The task requires long-context reasoning over 100K+ tokens of invoice history, business memory, and human corrections.
- Ramp’s stated goal is zero-click accounts payable, where invoices are processed correctly without human intervention.
More from Models
- Developer Building a Unified Leaderboard of All Model Benchmark Scores — airesearch12 · 2026-09-11
- Rumor claims Kimi faked performance by serving Claude; DeepSeek new model surprises in evals — realsohamparekh · 2026-09-11
- GPT-5.6 writes well but is instantly forgettable, user complains — BasedRaddka · 2026-09-11
- Opus Refuses Protein Research Codebase Over 'Safety' Concerns, Dev Considers Rolling His Own — josephdviviano · 2026-09-11
- User Hails Unconfirmed 'DeepSeek 4.1 Flash' as an Inflection Point in LLMs — himanshustwts · 2026-09-11
- Terminal Bench v4: GLM-5.3 Leads at 41.9%, Kimi-K3 Underwhelms at 12.6% — Ok_Warning2146 · 2026-09-11