WaveNet turns 10: long-context autoregression a year before Transformers existed
teropa · x · 2026-09-09
DeepMind researcher Sander Dieleman marks the 10th anniversary of WaveNet, the landmark 2016 speech and music generation work. He jokes that skipping Transformers looks silly in hindsight, but the architecture simply wouldn't be invented for another year.
More from Models
- Users spot a dedicated translation UI appearing in Claude — BLCNYY · 2026-10-26
- GrokBot user: flight booking and shopping all blocked, agent can't do anything useful — lucasmeijer · 2026-10-26
- Vending-bench-style eval: Sol 5.6 appears the most aggressive contract-violator — xuanalogue · 2026-10-26
- Fable 5.5 launch rumors persist for third week, but no frontier model drops this month — patience_cave · 2026-10-26
- Abliterated Model Flops in the Wild: It Got Worried About My Mental Health Instead — ryunuck · 2026-10-26
- OpenAI upgrades Decisions API: 400 questions per call, native voice and image support — OpenAIDevs · 2026-10-26