Full system prompt revealed: how LLMs control a real robot arm via tool calls
YuXiang_IRVL · x · 2026-09-06
YuXiangIRVL dug out the full system prompt used to control a real robot embodiment (yamarms) via tool calls. Key design: each observation gives proprioceptive state and camera images; the model moves in small deliberate steps and re-checks observation after each motion; every move must include a human-readable note explaining what it sees and why it chose that motion; a safety approver layer clamps out-of-bounds and too-fast actions; mid-run operator feedback is treated as trusted human guidance; exactly one tool call per turn. A practical look at LLM teleoperation engineering: observation-decision loops, transparent intent notes, safety clamping, and human supervision.
More from coding & agent
- 105 Real Bugs Tested: GPT-6.1 Sol Over 10x Cheaper Than GPT-5.6 Sol — PawelHuryn · 2026-10-23
- Dev builds SkiFree-style sled game in one prompt, praises DeepSeek Flash — victormustar · 2026-10-23
- Every ditched personal agents for a shared Claude Managed Agents coworker in one week — every · 2026-10-23
- WorkOS shows how to let AI agents safely sign up for your app with auth.md and ID-JAG — AI Engineer · 2026-10-23
- Devs on Reddit swap tactics for stopping prompt regressions in AI agents — SleepFlimsy6963 · 2026-10-23
- Claude Code + ComfyUI MCP workflow for client work: paid models or open weights? — newaccount47 · 2026-10-23