DepthBench resources: paper, code, and models all publicly available

FinanceYF5 · x · 2026-09-30

The author shares links to the DepthBench paper, code repository, and models. Following the earlier conclusion that depth could be the next scaling axis given the right residual connections (as shown by HC and Full AttnRes), readers can dig into the paper and reproduce the evaluation themselves.

Related event: DepthBench Benchmarks 10 Residual Connection Designs as Depth Emerges as a New Scaling Axis(5 posts)→

Original post →

More from Research

Research channel →