Running Jev as a real-time robotics policy in MuJoCo, with a two-call decide-then-act split

facontidavide · x · 2026-09-19

Developer @dimentary tested Jev as a real-time robotics policy in MuJoCo. When it struggled, the author split each update into two calls: one to decide what to do next, another to decide how to move the arm and gripper. Since Jev doesn't accept images, simplified geometry and contact information were fed to the model as text. The decide-then-act split offers a useful pattern for similar VLM-based robot control experiments.

Original post →

More from coding & agent

coding & agent channel →