Déjà View, a NeurIPS Oral: one looped transformer block matches 3D reconstruction models 8-10x its size
ZGojcic · x · 2026-09-26
The Déjà View paper has been accepted as a NeurIPS Oral. The authors ask whether 3D reconstruction transformers really need a billion parameters, finding most layers do redundant work. Their solution: a single transformer block looped K times. This tiny architecture matches or beats models like VGGT-Ω that are 8-10x larger, with lower compute — evidence of substantial parameter redundancy in 3D reconstruction models.
More from Embodied
- Lighthouse extends Obsidian welding foundation model to run on any robotic platform — bennash · 2026-11-11
- Sipeed's MaixStation Dock PCB returns, 14-layer SOM still in fab — AIFlow_ML · 2026-11-11
- NAE EU-US Frontiers of Engineering symposium explores AI-driven materials, robotics, neuromorphic computing — ProfBuehlerMIT · 2026-11-11
- Paper link for FLEX: robots generalize language corrections into preferences — JafarNajafov · 2026-11-11
- MIT and NYU's FLEX lets robots generalize a single spoken correction into broad preferences — JafarNajafov · 2026-11-11
- AI lets robotics research thrive in labs with no robotics experts — 4310sy · 2026-11-11