iamtrask: alignment is a data problem — without training data access you're in the dark
iamtrask · x · 2026-09-05
Researcher iamtrask argues that "alignment is a data problem": everything an AI knows, believes, or does can only come from training and RL data. Without unrestricted access to those records, alignment research is like finding an antidote without being allowed to study the poison — possible, but far harder. He admits making this case is unglamorous but trivial to defend.
More from AGI Musings
- Grady Booch revives Weinberg's 1971 quip: software so buggy one woodpecker could destroy civilization — Grady_Booch · 2026-10-23
- Why Netflix keeps losing to YouTube: UGC platforms professionalize easier than pro platforms go casual — ZeroStateReflex · 2026-10-23
- AI killed the coding moat: indie devs now compete on demand and distribution — sven_ai · 2026-10-23
- DynaVelo, a neural ODE model of single-cell dynamics, published in Nature Biotechnology — anshulkundaje · 2026-10-23
- Beff Jezos: Only frontier labs out-accelerating open source can secure systems — beffjezos · 2026-10-23
- 'I don't want to live in that world': a Redditor on why AGI utopia feels meaningless — peace_venerable · 2026-10-23