Grok 4.7 lifts Terminal-Bench 4.0 from 20.3% to 38%, but burns 125% more output tokens
dl_weekly · x · 2026-09-27
- Per dlweekly's evaluation newsletter, xAI's Grok 4.7 raised its Terminal-Bench 4.0 score from 20.3% (Grok 4.6) to 38.0%.
- The gains come at a cost: 125% more output tokens than 4.6, pushing the cost to $3.74 per Intelligence Index task.
- Takeaway: notable capability jump, but inference costs rose sharply alongside it.
More from Models
- Fable 5.2 Leads MazeBench Token Efficiency; Billion-Token Runs Underway — patience_cave · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16