Beyond looped transformers: dynamic test-time computation and self-introspection as the real lever
PlisSergey · x · 2026-09-03
Arguing the real leverage lies in dynamic test-time computation rather than recurrent depth, bobthemaster cites MIND over Body (ICLR Oral, beating ResNet-50 on ImageNet with 3 layers at 96.62%), Change of Thought (+20% accuracy via attention converging to fixed points, breaking the TC^0 ceiling), and Fixed-Point Self-Attention (zero extra parameters). PlisSergey adds that nested feedback and multi-level introspection are needed for autonomous sovereign AI.
Related event: Looped Transformer Debate: Just Deeper Networks or Real Recurrence?(8 posts)→
More from Research
- TRACE Open-Sourced: Migrating G1 Controller to Full-Size Humanoid H2 in 8 Hours on One GPU — zhengyiluo · 2026-10-18
- Humanoid Robot Funding Tops $3B as Brian Potter Explains the VLA Models Driving Robots — scottleibrand · 2026-10-18
- Terence Tao on 'War Footing' as OpenAI Claims Navier-Stokes Solve Shakes Mathematics — AlexTensor · 2026-10-18
- Univ. of Tokyo paper: why your recorded voice feels eerie — a vocal uncanny valley — ssh4net · 2026-10-18
- MIT's SANDO Drone Planner Avoids Every Moving Obstacle Across 12 Real Flights — Olivier__OG · 2026-10-18
- No-backprop pretraining speedup of 2.3x claimed, inspired by mech interp essay — CatAstro_Piyush · 2026-10-18