PufferLib 5.0: Five Coolest RL Results, from Multitask Drone Policies to Selfplay Robocode Champions
jsuarez · x · 2026-09-14
jsuarez rounds up the five most impressive RL results in PufferLib 5.0:
- Multitask drone policies: a single policy can both race and arrange into multiple formations, built by an intern.
- Robocode champions via selfplay: the team ported the classic tank-coding game and its strongest historical bots to a high-performance C PufferEnv. The standout result: agents trained purely via selfplay, never facing the reference bots directly, still beat every bot they train against.
- Craftax SOTA (post truncated).
The writeup highlights PufferLib's selfplay generalization in high skill-ceiling environments and multitask policy training.
Related event: PufferLib 5.0 Sets New RL Records on Craftax and NetHack(4 posts)→
More from Research
- ARC Prize 2026 closes in 3 days as Yi-Chia Chen tops ARC-AGI-3 at 75.56% — GregKamradt · 2026-10-31
- NVIDIA Nemotron 3.5 scales LLM self-verification, +9-10 points on agentic benchmarks — sarahcat21 · 2026-10-31
- Unofficial OpenTargets MCP Server Brings Gene-Drug-Disease Data to LLMs — modelcontextprotocol · 2026-10-31
- Researchers find 5 personality structures in LLM weight space, Big Five-like — luke_drago_ · 2026-10-31
- NVS benchmarks are misaligned: proper pose alignment puts 3D Gaussians back at SOTA — kwangmoo_yi · 2026-10-31
- arXiv moderator: submission surge causes months-long holds, new moderators wanted — tdietterich · 2026-10-31