Pascale Fung's ICML 2026 keynote: world models, not generative models, for real-world agents
pascalefung · x · 2026-09-16
Pascale Fung (Co-founder of AMI Labs, formerly Senior Director of AI Research at Meta-FAIR) has released the recording of her ICML 2026 invited talk, "Towards AI Agents In the Real World."
Key arguments:
- Today's AI agents are driven by imitation learning with RL on large-scale generative models—strong online but weak in physical-world settings;
- She argues for agents grounded in world modeling: integrating multimodal perception, reasoning-based planning and control, and memory to understand the physical environment, user intentions, and social context;
- Advanced machine intelligence requires modeling both the physical world and the mental world, including latent variables like intent, attention, and context;
- Her world-modeling research grew out of generative models' hallucination limits, and she outlines key challenges toward context-aware, interactive real-world agents.
More from AGI Musings
- Elad Hazan Recalls Two Decades of Online Convex Optimization — Born as a Job Hedge — HazanPrinceton · 2026-09-16
- Microsoft AI chief Suleyman calls to strip AI consciousness talk from training docs, jabbing Anthropic — pstAsiatech · 2026-09-16
- AI is not yet driving drug development, Axios reports — polymute · 2026-09-16
- Cambridge AI-risk scholar on whistleblower warnings: >10% extinction odds this decade — S_OhEigeartaigh · 2026-09-16
- Ben Bajarin 'supremely bullish' on AI buildout after Pat Gelsinger podcast — BenBajarin · 2026-09-16
- NYT Profiles the Recursive Self-Improvement Startups, Including Jeff Clune's Recursive Superintelligence — jeffclune · 2026-09-16