1D-RoPE Flaw Causes Frontier LLMs to Fail at Long String Copying

A recent study reveals that frontier LLMs still struggle to accurately copy long, repetitive strings despite their advanced reasoning capabilities. The research attributes this instability to limitations in standard 1D-RoPE, suggesting that 2D-RoPE can significantly improve performance.

2026-07-27 ~ 2026-07-27 · 2 related posts

• 2D-RoPE helps frontier language models copy long strings far more reliably — rohanpaul_ai · 2026-07-27
• Paper says frontier models still fail at exact copying as sequences get longer — eyishazyer · 2026-07-27