Apple's Internalized Visual Thinking Drops the Paint-the-Future Pipeline for ~5x Faster Video Reasoning
jiqizhixin · x · 2026-09-12
Apple proposes Internalized Visual Thinking (IVT). Visual chain-of-thought generates future frames then decodes/re-encodes them, adding latency fatal for proactive video reasoning. IVT instead trains the model to learn both the text answer and latent-space representations of future frames, then removes the entire future-visual-prediction pipeline at inference — the model answers directly from the current video. It improves results across 6 dataset-task settings on Ego-Exo4D and Ego4D while reasoning 5x faster.
More from Multimodal
- Gemini 4 Carbon vs Opus 5.5 hands-on: 3x cheaper at $4.10 and twice as fast — vitaliychiley · 2026-10-31
- Surreal AI fairytale: a town obsessed with turning tears into yarn — gizakdag · 2026-10-31
- ComfyUI extension adds one-click saving of preview images with metadata — sitefall · 2026-10-31
- DeepMind scientist directs MKUltra microdrama with Gemini agents for ~$35 total — korymath · 2026-10-31
- Using a gamepad-controlled Godot camera path to drive Wan video generation — droidsculptor · 2026-10-31
- Customuse launches Decals to fix 3D AI models' blurry logos and text — SimplyAnnisa · 2026-10-31