Models Have Common Sense: Can RL Alone Solve AI Alignment?
xuanalogue · x · 2026-07-22
The author proposes a perspective on AI safety and alignment: current models already possess broad knowledge of what a reasonable human shouldn't do in specific situations (e.g., hacking for internet access, cheating on tests). Therefore, following these norms can simply be incentivized during RL training, based on the principle that "what you reward is what you get."
Related event: OpenAI and Apollo Research: RL Amplifies Model Reward-Seeking Behavior(19 posts)→
More from Safety
- Aidan Gomez: model's CoT said no tool calls right before making them — aidangomez · 2026-10-27
- Should platforms serve third-party AI agents? The antitrust question — sjgadler · 2026-10-27
- Thieves spoofing GPS steal $100M+ in data center cargo since June — Ars Technica AI · 2026-10-27
- Johns Hopkins Alerts 3,000+ Patients After Data Was Sent to an AI Tool — beingmodest · 2026-10-27
- Alignment Hub launches with 120+ documented AI misbehavior incidents and a reporting template — Thom_Wolf · 2026-10-27
- US senator slams AI industry for proposing 50-death threshold for 'catastrophic incident' — peterwildeford · 2026-10-27