ToyBlocks Enables Controlled Robotic Eval: Depth vs Color, Compositionality, Planning

allen_ai · x · 2026-11-06

Allen AI describes the controlled experiments ToyBlocks supports: whether depth input improves robot control versus color images; whether models can stack four blocks without training on four-block stacks; and how models perform at planning long tasks. Researchers can also design their own evals.

Related event: AI2 Open-Sources ToyBlocks: Sim-Trained Robot Spells Words in 15/30 Real-World Trials(11 posts)→

Original post →

More from Embodied

Embodied channel →