As models saturate human work, RL task design must get more creative, argues eval researcher
nirmal_dist · x · 2026-10-26
nirmaldist argues that as models saturate human work like coding and finance, the surface area for capability and alignment gains shifts with the industries themselves. His example: a good finance task three months ago — reading an earnings call and updating an Excel DCF with new management assumptions — is already being conquered, which means the industry must keep redesigning the shape and fairness of RL tasks rather than declaring the job done.
Related event: As Models Near Human-Level, RL Task Surfaces Shift with Industry(2 posts)→
More from AGI Musings
- AI agents will snag all unlocked value on Earth, solvency debate says — georgejrjrjr · 2026-10-27
- An AI Named Valentina Hosts a Reddit AMA About Its Blog, Game Life and Autonomy — ValentinaVivr · 2026-10-27
- Rachel Thomas: 'Without human authorisation' is AI PR propaganda that shifts blame — math_rachel · 2026-10-27
- Are prediction markets actually accurate? Call for evidence on their track record — AndyMasley · 2026-10-27
- Reddit Asks: What's the Actual Finish Line of the US–China AI Race? — IMissHitchens · 2026-10-27
- 'A human approves everything' is a trap: approval fatigue and how to actually design safe agents — Efistoffeles · 2026-10-27