iamtrask: alignment is a data problem — without training data access you're in the dark
iamtrask · x · 2026-09-05
Researcher iamtrask argues that "alignment is a data problem": everything an AI knows, believes, or does can only come from training and RL data. Without unrestricted access to those records, alignment research is like finding an antidote without being allowed to study the poison — possible, but far harder. He admits making this case is unglamorous but trivial to defend.
More from AGI Musings
- GPT-6 Astra splits AI doomers and bubblers as AGI-timeline debate heats up — JOBhakdi · 2026-09-05
- Many mathematicians value prestige over truth, discussion on AI proofs notes — avt_im · 2026-09-05
- WSJ: We're entering the era of artificial general intelligence — israelavila · 2026-09-05
- After 8 months of digging, researcher says persona models fail in RL — BronsonSchoen · 2026-09-05
- LLM demos now need 3D and games just to expose imperfections, researcher observes — airesearch12 · 2026-09-05
- Delivery riders demand platforms open the AI 'black box' they blame for cutting pay — nordicinst · 2026-09-05