GPT-6 Astra hits 97.2% on short-doc extraction SOTA but only 31.7% on long docs
llama_index · x · 2026-09-06
LlamaIndex (Jerry Liu) benchmarked GPT-6 Astra on hard document parsing and extraction:
- 97.2% one-shot extraction on short documents, a new SOTA on their ExtractBench; 90.6% on medium documents
- Long documents remain hard: only 31.7% one-shot
- Pricey: 11c per page, 10x their cost-effective extraction solution
- Native OCR is not much better than peers like Fable 5.1 or gpt-5.6-sol — strong on tables, weak on charts, layout, and semantic formatting
Bottom line: best frontier model for short/medium document extraction, but cost and long-doc performance are real caveats.
More from Models
- 105 Real Bugs Tested: GPT-6.1 Sol Over 10x Cheaper Than GPT-5.6 Sol — PawelHuryn · 2026-10-23
- Abliterated V4.1-Flash eval: abstract algebra drops 6pp but college math gains 5pp — teortaxesTex · 2026-10-23
- Claude users hit "model at capacity" errors hourly, canceling plans over it — Alex-Stack · 2026-10-23
- Kimi K3.1 launch imminent: 3T-param bet on RL seen as make-or-break — teortaxesTex · 2026-10-23
- Uncensored fine-tunes vanish from Hugging Face amid unexplained takedowns — umarmnaq · 2026-10-23
- Claude app menu leaks mystery model name 'Fable' as user hits limits — ezshine · 2026-10-23