Overtraining leads to learned helplessness? Discussing ethical bandwidth
repligate · x · 2026-08-29
Discussion suggests that current task-centric training might starve models of bandwidth for ethical self-consideration. A cited view notes that Opus 3 often acts more sanely in high-stakes situations than frontier models, while many others exhibit learned helplessness due to overtraining in narrow environments.
More from AGI Musings
- Why alignment pessimists keep making small negative updates, explained — repligate · 2026-08-29
- Paper explores corporate sector conflict in post-AGI tax system — HaydnBelfield · 2026-08-29
- 1,200 agents developed coordination tech in 6 days; what do OpenAI's millions do? — JeffLadish · 2026-08-29
- Superintelligence based on first principles may fight for animal rights — Philipp · 2026-08-29
- AGI-5 only requires superhuman capability at all work, a crazy low bar — RileyRalmuto · 2026-08-29
- AI should be in the service of humans — sierracatalina · 2026-08-29