Kevin Murphy's Model Discovery Agent: LLM-assisted Bayesian experiment design hits SOTA
sirbayes · x · 2026-08-26
Kevin Murphy posted a major update (v4) to his paper "Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models" (arXiv:2608.09696), along with a talk video from U Toronto. The premise: science aims to learn mechanistic world models that answer interventional "what if" questions, and since experiments are expensive, learning must be data-efficient.
MDA combines three ingredients:
- a novel SMC³ algorithm with three nested levels of sequential Monte Carlo (models, parameters, latents);
- an LLM that proposes new models when the current hypothesis space is insufficient (M-open Bayesian inference);
- an experiment designer maximizing Value of Information.
It sets new SOTA on DPbench, CHEMbench and boxing, and introduces HHbench, a new stochastic single-neuron electrophysiology benchmark.
More from Research
- Scaling Laws Extrapolation Unreliable Due to Statistical Reasons — DanielKhashabi · 2026-08-26
- KostasVisualizations: Interactive Visualizations for Computer Vision and Machine Learning — CSProfKGD · 2026-08-26
- AI Scholar Praises Model Architecture Research: Value of 180B Scale Validation and Ablation Studies — kastnerkyle · 2026-08-26
- FixAnything: Unified 3D Rendering Artifact Repair via Video Generative Priors — gabriel1 · 2026-08-26
- Paper proposes a fix for running context recirculation issues — yogthos · 2026-08-26
- Study Finds Attention-Mask Checks Miss Causality Leaks in Sequence Models — VIDraft · 2026-08-26