Building a Real-Time NYC Digital Twin With Claude
davidfromkansas · x · 2026-07-11
Using real-world city data—including 86,000 street segments and 305,000 building footprints—a developer leveraged Three.js to procedurally generate a real-time 3D digital twin of New York City.
Core Features:
- Real-Time Data Tracking: Integrates live data from aviation, subways, buses, ferries, bike shares, traffic cameras, 311 complaints, weather, news, and even bird migration.
- AI Resident Simulation: Generated roughly 10,000 anonymized "synthetic residents" based on census records. Driven by LLMs, these residents react to real-time weather and news within the simulation (e.g., complaining about forgetting an umbrella when it rains).
- Agent Interaction: All data is merged into a "spatial intelligence layer" for LLM agents to reason with. A built-in "city concierge" can query real-time city dynamics and directly control the simulation, such as finding the nearest available rental bike near a specific bakery.
The project generates daily snapshots to record urban changes and is primarily built using the Fable 5 framework and Anthropic's Claude models.
Related event: Developer Builds a Real-Time Digital Twin of New York(3 posts)→
More from coding & agent
- Building a Secure AI Agent Gateway: Self-Hosting OAuth for Multiple SaaS Apps — Defiant_Cod_2654 · 2026-07-22
- Rowboat launches as an open-source, local-first AI coworker with memory — ycombinator · 2026-07-22
- Reddit user chains Ideogram 4 and Krea2 to mimic bbox-based image positioning — v3lh0t05c0 · 2026-07-22
- Apollo Cuts AI Assistant Skill Dev Time by 85% with Deep Agents — LangChain · 2026-07-22
- Scoble says AI “loops” really means long-running multi-agent workspaces — Scobleizer · 2026-07-22
- Kimi Code opens a waitlist as Moonshot rolls out its coding product — Fabulous_Bonus_8981 · 2026-07-22