GPT-6 Astra reviews: strong gains but benchmark claims questioned
Early reviews of GPT-6 Astra report major capability gains—such as shrinking 33,000 lines of SQL to 1,800—and halved per-task costs, though chain-of-thought monitoring broke. Critics note gaps between official benchmarks (97.6% on FrontierMath Tier 4) and independent tests (61), with doubled pricing for roughly parity.
2026-09-04 ~ 2026-09-04 · 3 related posts
- Episode 1: GPT-6 Astra pricing leaks: $10 input / $50 output per million tokens(2026-09-04, 7 posts)
- Episode 2: OpenAI Engineer: Token-Based Pricing Is Broken, Cost Should Be Measured Per Task(2026-09-04, 4 posts)
- Episode 3: GPT-6 Astra reviews: strong gains but benchmark claims questioned(2026-09-04, 3 posts)
- GPT-6 Astra reviews: half the per-task cost, but CoT monitoring breaks down — vista8 · 2026-09-04
- Astra scores 61 on independent index despite 97.6% FrontierMath hype, at 2.5x the price — eyishazyer · 2026-09-04
- GPT-6-Astra hands-on: smarter and creatively persistent, cuts 33k lines of SQL to 1.8k — i_dg23 · 2026-09-04