Multi-LLM social worlds are 'large': models may learn heuristics instead of grader-modeling
1a3orn · x · 2026-09-11
Continuing his discussion with jdpressman, 1a3orn argues multi-LLM training is probably complex enough that rather than fully modeling the grader, models might instead learn something like desired heuristics, since social worlds are 'large' worlds.
The author admits he isn't really sure, but the point echoes his earlier argument that environment design determines whether models solve problems or obsess over the grader.
Related event: AI researchers debate RL training routes and their side effects(11 posts)→
More from Research
- Skyfall AI's SKY-001 world model turns sketches into CAD builds in 3.9s, vs 199s for GPT-6 Astra — rohanpaul_ai · 2026-10-27
- Physicists Let AI Pick Its Own Problem—It Wrote a Publishable Paper in 2 Hours — burny_tech · 2026-10-27
- Researcher flags unresolved data transparency issues in compositionality evals — najoungkim · 2026-10-27
- Separate Forms from Estimators: Why Steer by Difference of Means When You Can Use SGD? — johnhewtt · 2026-10-27
- EMNLP paper probes why some LLM biases survive rewording while others don't — radamihalcea · 2026-10-27
- Datology webinar: Curation Studio matched top data baselines with under 20% compute — josh_wills · 2026-10-27