Controlled study: LLMs struggle to recover latent sequential structure despite long context

illinois · hf · 2026-10-09

A University of Illinois controlled study using Rock-Paper-Scissors and stochastic n-gram tasks finds LLMs struggle to recover latent sequential structure: longer context doesn't improve strategy identification, correct recognition doesn't ensure faithful simulation, and higher-order dependencies substantially degrade rule recovery—apparent behavioral fidelity can mask incorrect generative mechanisms.

Original post →

More from Research

Research channel →