From one prompt to photoreal Manhattan: Matt Shumer's five-step agent loop for GPT-6 Astra 3D worlds
mattshumer_ · x · 2026-09-08
Matt Shumer has used GPT-6 Astra to build a photoreal 3D Manhattan in Unreal Engine, a 1:1 browser-walkable replica of his childhood neighborhood with a playable zombie survival game, and a simulated civilization of autonomous agents — pulling over 15M views on X.
He published the full method (prompts included):
- No silver-bullet prompt; the loop is fixed: Reference → Assets → Assembly → Critique → Ship.
- Anchor on real references: force the model to ground on real-world imagery (or GPT-Image-2 generations), not imagination.
- Sub-agents: Astra dispatches dedicated sub-agents to sculpt assets headlessly in Blender, then assembles scenes in Three.js or Unreal Engine.
- Blind critic: an unyielding critic that never sees the render sits between output and reference, kicking flawed work back until it passes.
A practical recipe for developers aiming to reproduce high-quality AI-generated 3D worlds and games.
Related event: Matt Shumer Shares Full GPT-6 Astra 3D World-Building Workflow(2 posts)→
More from coding & agent
- One Agent Replaces Half an SDR Team: Full Lead-Research-to-Email Workflow — tibo_maker · 2026-10-23
- Why don't coding agent harnesses ship with their own sandbox? Only amp does — Aryvyo · 2026-10-23
- Dev builds a VST synth with Codex and MCP, lets the AI jam in his studio — Yamapama · 2026-10-23
- AgentsInTheCloud update: use your Claude subscription with built-in coding agents — lucasmeijer · 2026-10-23
- Phone agents vs. secure screens: banking apps treat helpful agents like malware — ghostmalone02 · 2026-10-23
- Power user puts Muse agent in charge of shopping, stocks, email, coding and a daily AI podcast — FuSheng_0306 · 2026-10-23