Two gaps in sequence: Koltun's is representation, Malik's is information — contact isn't on the screen

le_james94 · x · 2026-10-13

Closing take from lejames94's recap of four ETH embodied-AI lectures: Malik identifies an information gap, Koltun a representation gap — sequential, not competing.

The one disagreement: a simulated apartment may suffice for space, but not for contact. Space is on the screen; contact isn't — the simulator only supplies physics someone wrote down. The accompanying graphic maps what each speaker's system senses (image/video/contact) and notes representation gaps yield to training (13%→83% on puzzles), while information gaps need sensors; whether video-trained world models can learn contact remains unresolved.

Related event: ETH's Four Embodied AI Lectures: Malik, Koltun, LeCun Each Point to a Gap(3 posts)→

Original post →

More from Embodied

Embodied channel →