Chess model init: pretrained transformer body with fresh chess embeddings
andreisavu · x · 2026-11-08
Parts 11-12 of the chess transformer thread cover initialization:
- A pretrained transformer body is reused with fresh chess embeddings, adapted before full-network training.
- The author notes controlled playing tests are still needed to establish the actual benefit of this initialization and the auxiliary objectives — it remains an assumption, not a proven result.
More from Research
- The meta-question as agent swarms scale: can models beat gradient descent at its own game? — JensHonack · 2026-11-08
- Why can LLMs solve PhD-level math but still lose at chess? Reddit asks — MesloubFC · 2026-11-08
- WebHarbor launches: 153 mirrored real websites and 3,518 tasks for GUI web agents — HuaxiuYaoML · 2026-11-08
- METR Progress per R&D Dollar Fell 63% Even as Yearly Gains Doubled — sebkrier · 2026-11-08
- GenrobotAI's DAS Dex 2.0 captures 21-DoF hand motion plus 980 tactile points for robot learning — CyberRobooo · 2026-11-08
- fordycelab proposes benchmarking binder-design algorithms with Kd measurements on 24,000-VHH libraries — anshulkundaje · 2026-11-08