Hackathon Project Skillio Turns Vision Pro Into an AR Screw-Driving Coach Agent
seanmcdonaldxyz · x · 2026-09-15
Built at the AI Tinkerers LA global hackathon, Trillium Smith and Klaus Petersen open-sourced Skillio, an agent designed to live on a physical workbench instead of a chat window.
- The visual coach runs on Unity + Apple Vision Pro: both a wooden board and an electric screwdriver are optically tracked, with wireframe overlays and an arrow along the screwdriver showing where the next screw goes.
- A voice coach talks the trainee through each step while their hands are busy.
- The repo (xikaku-inc/skillio) is public and includes example MCP server integrations, plus a demo video.
More from coding & agent
- Atelier agent will auto-design custom Dockerfiles and preload workspace images per workstream — lucasmeijer · 2026-09-15
- Claude Code 2.1.271 is about to ship — ClaudeCodeLog · 2026-09-15
- Atelier nears release: run on your dev laptop, with an agent making projects remote-dev ready — lucasmeijer · 2026-09-15
- Creator Combines GPT-6 Astra With Godot and Blender for Striking Results — TheMoonMidas · 2026-09-15
- Rust dev build directories to shrink ~20% after fix for redundant compiler snapshots — charliermarsh · 2026-09-15
- Cursor team's bot praised as a shortcut to agent orchestration that takes days in Claude — MxMnr · 2026-09-15