A Rough Character Training Story: Self-Generating Ethical Data
geoffreyirving · x · 2026-08-23
Geoffrey Irving outlines a rough character training story related to philosophy of language: 1. Train the model; 2. Tell it to be 'ethical'; 3. Ask it to generate 'ethical' data for itself; 4. Train further; 5. ...? This illustrates a methodology of reinforcing specific traits through self-generated data loops.
Related event: Geoffrey Irving on the Philosophy of Character Training and Alignment(7 posts)→
More from Safety
- FDA pays small company to build a grading system for AI-written radiology reports — YvesMulkers · 2026-10-16
- OpenAI tells US judiciary there may be no reliable way to detect AI-generated images and videos — Polymarket · 2026-10-16
- Gartner: 75% of organizations have seen unauthorized use of AI coding assistants — moniquejmorrow · 2026-10-16
- [un]prompted conference to stage three AI security debates on vulns, defenses, jailbreaks — WeldPond · 2026-10-16
- User Questions AI Chat Logs Being Instantly Copied to Governments and Firms — Turn_Trout · 2026-10-16
- Alignment researcher Turn_Trout blasts AI assistants scraping private Signal chats without consent — Turn_Trout · 2026-10-16