ParseBench puts Claude Opus 5 near Opus 4.8 on docs, but cheaper rivals win on tables
llama_index · x · 2026-07-25
- A ParseBench evaluation found Claude Opus 5 is roughly on par with Opus 4.8 for document understanding.
- It does a bit worse on dense tables, but slightly better on charts and visual grounding.
- Gemini 3.6 Flash performs better on tables and is about half the price; LlamaParse agentic is stronger across the board, including tables, at roughly one-sixth the price.
- The takeaway: Opus 5 is fine for coding and knowledge work, but at about 8¢ per page and only average OCR performance, it is not a good choice for document parsing at scale.
More from Infra
- HBM demand shifts: low-stack inference plans shelved, Rubin to go 12-high only — BenBajarin · 2026-10-26
- CircuitHub unveils The Grid, a factory-scale robot making PCBs in the US twice as fast as Shenzhen — garrytan · 2026-10-26
- Ubicloud publishes "Fixing Tool-Call Accuracy in vLLM" — petrusenko_max · 2026-10-26
- Meta approves nonvoting Class C shares as 2026 capex guidance hits $135B–$145B — thione · 2026-10-26
- Unsloth Ships MiniMax-M3.1-Flash Quants: 2-bit Retains 91.5% Accuracy, Runs in 150GB RAM — danielhanchen · 2026-10-26
- Engineer with thousands of fabricated devices pours cold water on photonic crystal modulator yields — jwt0625 · 2026-10-26