Study: Frontier AI Time Horizon Reaches 14 Hours at 50M Token Window
tomekkorbak · x · 2026-07-03
The AI Safety Institute found that the time horizon of frontier AI evaluated under a 50M token context window is about 60% shorter than under a 2.5M token window. Specific data: The frontier time horizon is 2 hours under the 2.5M token window, and 14 hours under the 50M token window.
This finding indicates that the true trends of AI capabilities can only be observed when given a sufficiently large context budget—the choice of evaluation window fundamentally affects the conclusions drawn about the frontier level of AI.
Related event: Frontier AI Task Duration Doubles, Slowed by Budget Constraints(3 posts)→
More from Safety
- Why So Many AI Researchers Think the Machines Could Kill Everyone — wiredmagazine · 2026-09-11
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- a16z podcast: why 2-3 person startups are absent from policy debates — a16z Podcast · 2026-09-11
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- MD shows buying lab media requires background checks, calling AI bioweapon doom scenarios implausible — Ghost_Pilot_MD · 2026-09-11