Vincent Sitzmann: traditional computer vision is about to go away

vincesitzmann · x · 2026-10-22

MIT professor Vincent Sitzmann publishes an essay arguing that computer vision as we know it is ending: mapping images to intermediate representations (segmentation, 3D, tracking) is a historical artifact, vision is only well-defined within perception-action loops, and the boundaries between vision, robot learning, and control will dissolve. He predicts 3D representations will fade from embodied intelligence, and adds that scaling up video models will carry these algorithms into the real world since it is fundamentally just generative modeling.

Original post →

More from Research

Research channel →