PufferLib 5.0 Released: Train RL Agents in One Second

PufferLib 5.0 trains reinforcement learning agents in about one second, with 5x faster solving than 4.0 and peak throughput over 60 million steps per second. It abandons Python for under 10,000 lines of CUDA C implementing five-layer deterministic parallel training, with demo agents playable at puffer.ai.

2026-09-14 ~ 2026-09-14 · 4 related posts

• PufferLib 5.0 released: trains RL agents in under a second — jsuarez · 2026-09-14
• PufferLib team showcases 5 new results with playable agents online — jsuarez · 2026-09-14
• PufferLib 5.0 ditches Python: bitwise-deterministic async training in under 10k lines of CUDA C — jsuarez · 2026-09-14
• PufferLib 5.0 is ~5x faster than 4.0, peak throughput over 60M SPS — jsuarez · 2026-09-14