YacineMTB Doubles Down: PufferLib's PPO Plus Tiny RNNs Is All You Need

yacineMTB · x · 2026-10-03

Reiterating that PPO is all you need — no asymmetric actor-critic, just small RNNs under 1M params — YacineMTB names PufferLib's PPO as the implementation to use.

Related event: Yacine: PPO with a small RNN under 1M parameters is enough for RL(2 posts)→

Original post →

More from Research

Research channel →