Kevin Murphy unifies goal-based hierarchical RL with ACGVF and his 25-year-old HHMM work
sirbayes · x · 2026-09-15
Kevin Murphy released a mini-paper, "A note on goal-based hierarchical RL", unifying Tasse et al.'s agent-centric general value function (ACGVF) construction — which lets the agent choose which goal to pursue and when a goal is finished — with his own 25-year-old work on hierarchical hidden Markov models (HHMMs). ACGVF subsumes nearly all prior RL, control and planning formalisms but assumes fully observed environments; Murphy's earlier belief-state agent design assumed externally provided goals. The note extends both via the HHMM formalism, though no experiments yet.
More from Research
- Can human minds exit their sensory distribution? Rethinking the baseline for AI creativity — weballergy · 2026-11-22
- Claude did three jobs in the Riemann Hypothesis proof: finding, checking, explaining — Prestigious_Bag_5349 · 2026-11-22
- Kaggle competition pitched to compress LEAN theorem proofs like code golf — MeganRisdal · 2026-11-22
- LATO.2 open-sourced: image-to-low-poly 3D mesh with controllable vertex counts, runs on 8GB VRAM — Promptmethus · 2026-11-22
- What Leibniz's Monadology teaches about agreement between AI agents — Philo167 · 2026-11-22
- In 2026, still no adversarially robust model on CIFAR-10 (73.7% cap) — maksym_andr · 2026-11-22