"Recurrent depth" is just weight tying, not true arbitrary-depth recurrence
snwy_me · x · 2026-09-03
@llllvvuu challenges the hype around "recurrent depth": the technique appears to be essentially weight tying — reusing the same weights across layers — rather than genuine arbitrary-depth recurrence, making it an odd thing to make a big deal out of.
More from Research
- Researcher claims they may have 'cracked RL' for their task — andrew_n_carr · 2026-09-03
- Judea Pearl fires back in causal inference debate: RCT's new language deserves open scrutiny, not hiding — yudapearl · 2026-09-03
- Genomics researcher calls out popular benchmarks as opaque and flawed — anshulkundaje · 2026-09-03
- Untrained networks already tell cats from dogs: architectures as evolutionary selection — joannejang · 2026-09-03
- CS professor builds AI system to preserve endangered languages and create new ones — begusgasper · 2026-09-03
- Cosmos Institute funds 80 grantees building AI for human autonomy and truth-seeking — hunarbatra · 2026-09-03