Deep RL Books Criticized for Spending 50-70% on Tabular Methods

burkov · x · 2026-08-16

While surveying existing deep RL books for a new project, the author notes that most volumes dedicate 50% to 70% of their content to tabular RL and Markov decision processes. He questions this approach, arguing that readers seeking tabular RL content would not choose books explicitly titled with 'deep'.

Original post →

More from Research

Research channel →