GPT-6 Astra builds 3D scenes from video, augmented with SAM3, Pi3X and Blender sim
yshan2u · x · 2026-09-28
Siyuan Bian demonstrates that GPT-6's Astra can build 3D scenes from video, but notes gaps in accuracy, physical plausibility, and interactivity.
The team's approach: integrate 3D vision tools into Astra's agentic workflow — Pi3X, SAM3, GVHMR/Kimodo for human motion capture, and Blender simulation — to make generated scenes more physically grounded and richly interactive. A demo video is linked.
More from coding & agent
- Study of 2,170 GitHub projects maps how the fast, low-cost Jev decision model is used in the wild — CUHK-CSE · 2026-09-28
- Anthropic releases free 37-minute guide on building AI agents that automate entire businesses — Aiden_Tech_Ai · 2026-09-28
- Spotify paper: synthetic multi-turn dialogs and self-improvement loops boost conversational recsys quality by 8% — _reachsumit · 2026-09-28
- RecToolBench: 1,200+ Task Benchmark Tests Recommender Agents on MCP Tool Orchestration — _reachsumit · 2026-09-28
- Grok Build v1.0.43 fixes MCP prompts going missing and hanging silently in minimal mode — XFreeze · 2026-09-28
- Dev Open-Sources Claude Code Skill That Makes Full AI Music Videos End-to-End — TimothyDuignan · 2026-09-28