Explicit gesture input failed AR/VR — AI contextual interpretation is the missing piece
mrjonfinger · x · 2026-09-06
Jon Finger argues investors distrust AR/VR because explicit gesture input failed in the last hype cycle — it demands exhausting, precise repetition from users.
The real missing element, he says, is fully interpretive gesture understanding grounded in visual context — the same non-language-specific interpretation power diffusion models showed with text-to-image. Once that works, AR/VR changes entirely, and natural language recedes to casual social input, at best the third-most-important input to physical action.
The quoted thread adds: AI now makes building 3D worlds cheap, but the rest — hardware, a proper OS, UI/UX, real 6DoF experiences — is still missing.
More from AGI Musings
- India needs an "AI defence force": experts warn of agent swarms and AI worms — ravi_iitm · 2026-10-23
- Anti-AI Slop Books: open tools to detect AI-generated books — TuhinChakr · 2026-10-23
- Founder predicts mass tech layoffs as 2-person AI teams replace big corp teams — kingslyj · 2026-10-23
- Social scientist: CS treats agentic development as a magic black box — RexDouglass · 2026-10-23
- Blogger slams Anthropic for wanting approved institutions to gate access to AI — VraserX · 2026-10-23
- Senior researcher rebuts 'one-person pretraining' fear: your fundamentals matter more, not less — RexDouglass · 2026-10-23