PufferLib 5.0 trains a Rubik's Cube solver at 8.8M SPS on a single 12GB GPU

haydendevs · x · 2026-11-11

A developer posted a screenshot of PufferLib 5.0 in action: training a Rubik's Cube environment on a single 12GB card at 8.8 million steps per second, with the GPU pegged at 100% while using only 1.8GB of VRAM.

Key stats from the panel: 280.5M steps, epoch 1070, 621ms per evaluation; perf and score both at 1.000, shortest solve 29 steps, policy and value losses near zero. The caption is just "uhhhhh guys"—clearly stunned by the throughput. PufferLib is the well-known extreme-speed RL training library, and this screenshot is its best advertisement.

Original post →

More from Infra

Infra channel →