Stabilizing RL with a simple second-year probability trick: the covariance identity
PMinervini · x · 2026-09-19
zainhas shared how a basic undergraduate probability identity — E[AB] = E[A]E[B] + Cov(A,B) — can stabilize RL training. Reposting it, hyhieu226 quipped that most tricks that actually work in AI are 'second-year probability undergrad' level. A resonant take on how foundational math remains the most practical tool in RL.
More from Research
- Meta's Atomic Creator Tokens beat Semantic IDs: +19.8pt Recall@15 and 2.7x lower latency — _reachsumit · 2026-11-04
- HiGenTrans transfers LLM knowledge into generative recommenders at input, representation and decision levels — _reachsumit · 2026-11-04
- SA-OPSD distills self-teacher knowledge at beam-search pruning boundaries for generative recommendation — _reachsumit · 2026-11-04
- MV-Thinker: Multi-View Thinking with Adaptive Generation for Generative Recommendation — _reachsumit · 2026-11-04
- ByteDance details USDB storage system: 85.8% lower write latency for recommender sequences — _reachsumit · 2026-11-04
- Kuaishou's UAGR injects utility signals into semantic codes and decoding for generative recommendation — _reachsumit · 2026-11-04