Full system prompt revealed: how LLMs control a real robot arm via tool calls
YuXiang_IRVL · x · 2026-09-06
YuXiangIRVL dug out the full system prompt used to control a real robot embodiment (yamarms) via tool calls. Key design: each observation gives proprioceptive state and camera images; the model moves in small deliberate steps and re-checks observation after each motion; every move must include a human-readable note explaining what it sees and why it chose that motion; a safety approver layer clamps out-of-bounds and too-fast actions; mid-run operator feedback is treated as trusted human guidance; exactly one tool call per turn. A practical look at LLM teleoperation engineering: observation-decision loops, transparent intent notes, safety clamping, and human supervision.
More from coding & agent
- Code Arena Launches WebDev Leaderboard Ranking AI Coding Models — arena · 2026-09-06
- Astra handles UV unwrapping, hinting at automating artists' grunt work — rms80 · 2026-09-06
- Macroscope ships Murmur, the in-house tool that let engineers direct dozens of cloud agents — Rasmic · 2026-09-06
- Astra disappoints on harness-building tasks while Fable 5.1 excels, dev reports — HarveenChadha · 2026-09-06
- Andrew Ng: prompting will be dead in 6 months, graphs are replacing it — nikola_mr64990 · 2026-09-06
- GPT-6 Astra designs a working jet plant and ships a live 3D simulation autonomously — deanwball · 2026-09-06