Paper says frontier models still fail at exact copying as sequences get longer
eyishazyer · x · 2026-07-27
A reply summarizing a paper that argues frontier language models can still fail at exact copying even when they solve advanced reasoning tasks.
- Copying gets less reliable as sequences get longer or more repetitive.
- The issue is partly architectural: with standard 1D RoPE, generating output token yk depends on retrieving xk from a relative offset that shifts with input length.
- The post frames this as a reminder that architecture choices can strongly affect seemingly simple behaviors like verbatim repetition.
Related event: 1D-RoPE Flaw Causes Frontier LLMs to Fail at Long String Copying(2 posts)→
More from Research
- Yale PhD student open-sources his paper figure scripts, packaged as a Skill for Claude Code and Cursor — burny_tech · 2026-09-23
- AI models now match superforecasters on ForecastBench; rematch set for October — burny_tech · 2026-09-23
- Dev uses Opus 5.5 with Lean to formally verify Claude Agent SDK, yielding 16 bug-fix PRs — bcherny · 2026-09-23
- Mathematicians, not just LLMs, made AI's math breakthroughs possible, scholars argue — tak3sh8 · 2026-09-23
- AI-enabled drug discovery cuts discovery time by 15-80%, McKinsey research finds — menhguin · 2026-09-23
- Gemini training details dissected: groupwise reward redistribution to fight reward hacking — nrehiew_ · 2026-09-23