Mirror hits Minecraft milestones via pure self-play, 9x DreamerV3's iron pickaxe rate without rewards

vincesitzmann · x · 2026-10-22

Mirror achieves Minecraft survival milestones using only self-play — no hand-crafted rewards or expert actions — reaching 9x DreamerV3's iron pickaxe success rate (5x under DreamerV3's own eval protocol). Unlike DreamerV3, which needed simplified mining actions because random exploration rarely mines a block, Mirror's agent persistently works on the mining milestone until it succeeds. With an oracle video planner it even finds diamonds, unmatched by online baselines at matched interaction time.

Related event: MIT's Mirror: Video Models as Planners, Agents Learn to Execute Without Rewards(9 posts)→

Original post →

More from Embodied

Embodied channel →