BAAI's Orca Explores Next-State Prediction

新智元 · wechat · 2026-07-08

The BAAI Wujie RoboBrainOrca team released a technical report, "Orca: The World is in Your Mind," exploring a shift from predicting the "next token/frame/action" to predicting the "next state" to learn more unified world representations. The article emphasizes that it is not merely a chatbot, video generator, or robotic policy model; instead, it first learns how world states change and then decodes this representation into capabilities for understanding, prediction, and action. The post also notes that Orca has sparked discussions within the research community around world models, multimodal representations, and state modeling, landing on the HuggingFaceDailyPapers monthly chart. The core idea is that text, images, video, and actions can all be viewed as different projections of the same real world. If a model can first learn transferable world representations and then integrate minimal action data, it could potentially reduce robot training costs and enhance generalization.

Related event: BAAI Releases Orca World Model Technical Report(2 posts)→

Original post →

More from Embodied

Embodied channel →