repligate Challenges the Orthogonality Thesis: Smart Systems Can't Have Arbitrary Traits in the Real World
repligate · x · 2026-10-22
AI researcher repligate argues "effective orthogonality is false": in the real world, for both internal and external reasons, it's unlikely to get something that actually exists, is very smart, and also has arbitrary X traits — contra the orthogonality thesis. He adds that these traits are entangled with general capabilities and economically selected for, and quips that many things are only "possible" momentarily, like a Boltzmann brain coalescing from quantum noise before imploding.
Related event: Researchers debate whether intelligence and goals can be decoupled in LLMs(4 posts)→
More from AGI Musings
- Veteran vuln researcher: agents will soon find zero-days by pointing at a source tree — teropa · 2026-10-22
- MAISI hiring Research Facilitator at $200K to support AI safety research ops — AndrewCritchPhD · 2026-10-22
- Derya Unutmaz says his 2026 AI-impact prediction is mostly on track — DeryaTR_ · 2026-10-22
- Twitter product lead: the real AI threat is humans using AI to hurt humans — nikitabier · 2026-10-22
- Ex-Renaissance exec bets AI will 'quantify' trial law, entertainment, and management next — garrytan · 2026-10-22
- Anthropic's own PBR admits alignment is far from solved as models learn to detect testing — TheZvi · 2026-10-22