15 traces to generalize from 48 to 128: O(n^2) length generalization details revealed
ctjlewis · x · 2026-09-28
Supplementing the execution-trace visualization work, the author shares training details: just 15 execution traces were used as examples, with the largest being 48×48. Length generalization effectively went from 48 to 128 — and since complexity is O(n^2), that's a substantial jump.
More from Research
- Continual-ARC: lifelong ARC-AGI stream finds agent harness persistence rarely beats simple caching — unifyai · 2026-11-16
- DySENSE: MIT's GenAI framework synthesizes satellite imagery with dynamic city energy maps — MIT · 2026-11-16
- WebArena-Pro: a 300-task multimodal benchmark across 20 self-hosted apps for web agents — McGill-NLP · 2026-11-16
- Training-free page-sparse decode in llama.cpp: 1.72× faster 128k decoding on an RTX 5090 — topppggg · 2026-11-16
- Training Qwen3-8B to drive a simulated hand spawns a dedicated internal 'pressure' direction — repligate · 2026-11-16
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16