Self-Guided TTT: Self-Selecting Training Segments at Test Time

bronzeagepapi · x · 2026-07-18

This repost highlights a research project by Meta and UVA called Self-Guided TTT.

The author notes that while LLMs can read long contexts of 100k+ tokens, "being able to read" doesn't equate to "using it well." Existing Test-Time Training (TTT) helps models adapt to new inputs during testing, but the prerequisite is training on the correct tokens.

Their improvement allows the model to autonomously select which segments are worth training on at test time, thereby focusing the adaptation process on more useful information.

Original post →

More from Research

Research channel →