DepthBench: Residual Connection Design Caps Effective Computational Depth
A new paper introduces DepthBench, a benchmark showing that residual connection design determines whether model depth translates into effective computation, positioning effective computational depth as a new scaling dimension.
2026-09-29 ~ 2026-09-30 · 2 related posts
- DepthBench: residual connection design decides whether depth is a real scaling axis — Intelligent-Systems · 2026-09-29
- DepthBench paper finds Pre-LN variants hit a depth wall, comparing 10 residual designs — teortaxesTex · 2026-09-30