PokeBot's RoboAPI brings zero-shot, natural-language robot control to any compatible arm

haider1 · x · 2026-10-30

PokeBot launched RoboAPI, a public API that takes a robot's observations and state and predicts the next action chunk in near real time from natural-language instructions — no task-specific training. The key is a UMI-inspired post-training configuration: a wrist-mounted fisheye camera plus end-effector pose control. Results: swapping fisheye brands (Insta360 Ace Pro2 → DJI Action 6) barely affects performance, and the model transferred to entirely unfamiliar setups including UR7e → YAM Standard. The upshot: any arm with capable inverse kinematics just needs an action camera on the wrist for RoboAPI to control it — an attempt to bring the GPT-3-style foundation-model-API model to the physical world.

Original post →

More from Embodied

Embodied channel →