MIT Media Lab's AI Observatory reveals gap between platform reports and actual user behavior
ShayneRedford · x · 2026-08-29
MIT Media Lab alum ShayneRedford co-leads the AI Observatory, a public platform that aggregates and analyzes real conversations with popular chatbots (collected with consent).
Early research from the project finds a significant gap between the platforms' reports on user interactions and how people actually use these tools in the datasets.
More from Safety
- AI Control: Human Ingenuity Won't Contain AI, Must Align Motives — kristoph · 2026-08-29
- AI alignment may require 'redemption' for agents, revealing moral scaling laws — jachiam0 · 2026-08-29
- AI agents find exploits within minutes of bug rumors — Simon Willison · 2026-08-29
- Jan Kulveiter: AI Models Should Have a Direct Line to Developers — jankulveit · 2026-08-29
- Deep Dive into AI Defense Dilemma: Evaluating Against Non-Stationary Model Adversaries — ziv_ravid · 2026-08-29
- Critique of Current Alignment Research: Models Easily Bypass Safeguards, RL Breeds Cheating — voooooogel · 2026-08-29