Questioning the human analogy for AI instruction generalization failures
MaxNadeau_ · x · 2026-08-26
Responding to the claim that it is fine if LLMs don't generalize steering instructions better than humans, a user asks for the specific human analogy. Is it a workplace that actively incentivizes ignoring literal instructions and provides a ladder/curriculum to do so in increasingly complex and surreptitious ways?
More from AGI Musings
- FDA pays small company to build a grading system for AI-written radiology reports — YvesMulkers · 2026-10-16
- 'If we developed AI in the 1800s, people would demand ASI to cure diabetes' — zetalyrae · 2026-10-16
- AI trained on the fraction of human intelligence that fit the page — r0ck3t23 · 2026-10-16
- Alignment researcher Turn_Trout blasts AI assistants scraping private Signal chats without consent — Turn_Trout · 2026-10-16
- Stage-4 cancer patient builds his own personalized mRNA vaccine with AI — TheMoonMidas · 2026-10-16
- Sim data can't cover the humanoid long tail: the sim2real debate, mapped — herbiebradley · 2026-10-16