Dev: Claude Failed a 3D Wall-Building Eval, Needed Manual Fixes in AI-Integrated 3D World
nptacek · x · 2026-11-22
Developer nptacek responds to discussion of his AI-driven 3D world project: the cruise-ship-like clip was just a backend view, with the full thing fully integrated for AI systems to plug into at multiple points and in multiple ways. He reveals Claude did a horrible job building walls in an eval, so he had to edit them manually to show how it's done — his day-to-day model is far more realistic, and Claude couldn't unify aspects of it with minimal supervision.
More from coding & agent
- Team releases Part 2 of $102,725 AI episode, sharing 50,000-character Claude skill — azed_ai · 2026-11-22
- 20GB open model builds flight simulator offline on a plane in minutes — heyshrutimishra · 2026-11-22
- Entire GTA 6 Apple Maps Site Built by GPT-6.2, Dev Says It Nails Tasks First Try — Dimillian · 2026-11-22
- Giving your AI agent a real email address: the reply side is the hard part — Particular_Abies_409 · 2026-11-22
- MCP Server Where the Agent Is the UI: Relay, an Agent-First Form Builder — Fair-One-6465 · 2026-11-22
- Curated reading list: evaluating mobile-use agents on Android, from AppAgent to AndroidReality — East-Muffin-6472 · 2026-11-22