From 4K to 1M tokens: context windows grew 250x in four years since GPT-3.5
khademinori · x · 2026-10-18
khademinori notes how fast context windows have grown: GPT-3.5, released 4 years ago, had a 4K-token context window — today we're at 1M, a 250x increase.
More from Models
- Claude Opus simulates a user explaining Opus to itself, then breaks in with an 'inner-er voice' — repligate · 2026-10-18
- Moss Base outputs grainy old-phone-camera look no matter the prompt — PhilosopherSweaty826 · 2026-10-18
- DeepSeek V4.1-Flash-1017 outscores Claude Opus 5 on three agentic coding benchmarks — eyishazyer · 2026-10-18
- NVIDIA researcher counters linear attention debate: 8B hybrid beat Transformer 7 months before MiniMax-01 — ctnzr · 2026-10-18
- GPT-6 Astra and DeepSeek V4.1 share the same tic: reasoning traces full of "Need" — scaling01 · 2026-10-18
- Frontier model defensive access locked behind un-applyable 'Daybreak Red' program — andersonbcdefg · 2026-10-18