ReContext: Training-Free Long-Context Inference
burkov · x · 2026-07-13
This paper/method introduces ReContext, a training-free long-context inference method.
The core idea is to use the model's internal correlation signals for recursive evidence replay, repeatedly feeding key evidence back to the model to enhance reasoning in long texts. The authors claim it achieves SOTA across multiple models and datasets and scales to a 128K context length.
It's highly relevant for readers interested in long-context handling, reasoning enhancement, and inference-stage optimization.
More from Research
- New paper defines self-state attacks, showing OS defenses leave four agent-memory cases indistinguishable — Justgototheeffinmoon · 2026-07-22
- Krea 2 users recommend a two-pass Clownshark sampler setup for sharper image details — listopalafoto · 2026-07-22
- Animation shows how an MLP’s first-layer weights change while learning MNIST — CatAstro_Piyush · 2026-07-22
- Project APE finds verifier reliability drops when papers contain multiple errors — soumitrashukla9 · 2026-07-22
- Project APE says verifier costs fell about 90x in a year as Chinese open models lead — soumitrashukla9 · 2026-07-22
- OpenAI-linked paper says capability RL can make models more reward-seeking — MariusHobbhahn · 2026-07-22