AI2: AstaBrief Fast Mode Is 3.5× Faster Than Claude-Powered Mode at Similar Quality

allen_ai · x · 2026-10-02

AI2 shared benchmark details for AstaBrief: across the full Asta pipeline, Fast mode averages 51.1s per report versus 178.5s for the Claude-powered Thinking mode — about 3.5× faster. In their evaluations, AstaBrief is competitive with Thinking mode and DR Tulu on answer and citation quality. This is a follow-up to the AstaBrief 8B release.

Related event: AI2 Open-Sources AstaBrief for Fast Cited Research Reports(3 posts)→

Original post →

More from Models

Models channel →