Frank Hutter on TabPFN: tabular foundation model predicting in a single forward pass
Machine Learning Street Talk · youtube · 2026-09-24
Machine Learning Street Talk interviews Prior Labs co-founder Frank Hutter on TabPFN, a tabular foundation model that predicts in a single forward pass.
- Key idea: pre-train on synthetic datasets sampled from a prior over structural causal models; at prediction time the whole training table becomes context, approximating the Bayesian posterior predictive distribution without per-dataset training or hyperparameter search
- Topics: why tabular data resisted deep learning, scarcity of public tabular data, the path from AutoML and NAS to TabPFN, the TabArena benchmark, architecture changes from v1 to v3, scaling to larger tables, test-time compute, Google's TabFM, causal inference and interventions, relational data
- Also covers using TabPFN with coding agents; ends with a recorded update on the TabPFN-3.5 release, with a full reference list
Related event: Frank Hutter on TabPFN: Tabular Foundation Model in One Forward Pass(2 posts)→
More from Models
- Theory: Typos Disrupt LLM Tokenization, Which May Explain Why AI Text Has a Distinct Smell — menhguin · 2026-11-11
- LMArena co-founder explains AI evaluation methodology and policy in new podcast — MattPerault · 2026-11-11
- Runway open-sources Praxis-1, turning video pretraining into real robot control — runwayml · 2026-11-11
- DeepMind launches AlphaGenome 2, spotting nearly 2x more gene-regulating mutations — GoogleDeepMind · 2026-11-11
- MazeBench: Fable 5.2 scores 15%, near-frontier at half price; Gemini 4 Carbon 11% — patience_cave · 2026-11-11
- ERNIE 5.5 Flash Preview enters LMArena Battle Mode for crowdsourced ranking — arena · 2026-11-11