Task isolation against label leakage in a chess transformer with lookahead objectives
andreisavu · x · 2026-11-08
Parts 5-6 of the chess transformer thread cover auxiliary objectives and leakage control:
- Auxiliary objective: a second task predicts one sampled move at an offset of 2-9 plies, with a single move per target and no intervening sequence or principal variation, forcing the model to infer the resulting position.
- Task isolation: policy and value heads use only the history representation and never see the gold board, future-move or outcome labels supplied to auxiliary branches, preventing label leakage.
More from Research
- The meta-question as agent swarms scale: can models beat gradient descent at its own game? — JensHonack · 2026-11-08
- Why can LLMs solve PhD-level math but still lose at chess? Reddit asks — MesloubFC · 2026-11-08
- WebHarbor launches: 153 mirrored real websites and 3,518 tasks for GUI web agents — HuaxiuYaoML · 2026-11-08
- METR Progress per R&D Dollar Fell 63% Even as Yearly Gains Doubled — sebkrier · 2026-11-08
- GenrobotAI's DAS Dex 2.0 captures 21-DoF hand motion plus 980 tactile points for robot learning — CyberRobooo · 2026-11-08
- fordycelab proposes benchmarking binder-design algorithms with Kd measurements on 24,000-VHH libraries — anshulkundaje · 2026-11-08