Researchers argue the harness, not the transformer, should generalize through composition
eliebakouch · x · 2026-07-22
A short reply celebrating a research idea: transformers struggle to generalize to unseen tasks, so the proposed direction is for the harness itself to generalize through composition.
The post also points to an observed property in RLM training: for tasks with shared structure that look different on the surface, the root model can learn the same trajectory, effectively treating the two task traces as equivalent.
Related event: Research Suggests RLM Generalization is Driven by External Harness(10 posts)→
More from coding & agent
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Two engineers rebuilt a FedEx supplier's billing core in 3.5 months vs an estimated 7-8 — alex_verem · 2026-10-27
- GPT-6.1 Terra gains ~20 points on Terminal-Bench 4.0, rivalling GPT-6.1 Sol — ArtificialAnlys · 2026-10-27
- GPT-6.1 Terra scores 48 on AA Coding Agent Index at one-third the cost of GPT-5.6 Terra — ArtificialAnlys · 2026-10-27
- Shift-1 router cuts coding agent spend up to 55% while keeping SWE-bench accuracy — ypatil125 · 2026-10-27