Pedro Domingos: It's Time to Call Residual Streams What They Are — RAM
pmddomingos · x · 2026-09-10
Prominent ML researcher and author Pedro Domingos argued that residual streams in Transformers should simply be called RAM, pointing out they act as the model's memory that layers read from and write to. The analogy is sparking discussion about how we name and understand Transformer internals.
More from Models
- ChatGPT web image generation ignores thinking mode, wasting a usage per attempt — TheSynthian · 2026-09-10
- Google WeatherNext AI beats standard models at cyclone forecasts, adds a day of warning — nordicinst · 2026-09-10
- DeepSeek V4.1 Flash Finds 44 Vulnerabilities at $0.29 Each, 35× Cheaper Than Opus 5 — teortaxesTex · 2026-09-10
- Google's Logan Kilpatrick: Gemini 4 will keep pushing the frontier on cyber — OfficialLoganK · 2026-09-10
- Japanese doctor recreates coronary angiography teaching demo with GPT-6 Astra — TheMoonMidas · 2026-09-10
- Iron Man fan builds interactive suit teardown site with GPT-6 Astra, Three.js — TheMoonMidas · 2026-09-10