CONGA compiler exploits Gaussian block geometry for Bayesian inference, 12.5x ESS/s gain for NUTS
Víctor Gallego · hf · 2026-11-19
Víctor Gallego releases the paper CONGA: Compiling Gaussian Fiber Geometry for Structured Bayesian Inference (arXiv, Nov 16, 2026; open-source code).
- Problem: in structured Bayesian models a large latent block is often Gaussian conditional on a small parameter set, yet generic inference methods relearn this geometry during warmup.
- Method: conditional mean and precision determine exact affine maps (symmetric Brenier, triangular Knothe-Rosenblatt) that separate a standard normal block from the non-Gaussian core; KL and relative Fisher objectives reduce to objectives on that core. The CONGA compiler identifies candidate Gaussian blocks and picks temporal, spectral, or sparse implementations by structure and cost.
- Theory note: marginalization requires an identity established from the model itself; numerical evidence alone permits only a target-preserving change of variables, and a failed check leaves the model unchanged.
- Results: 12.5x better minimum ESS/s for NUTS on the Stock-Watson inflation model; restores convergence for WALNUTS on the same model and for NUTS on a 6760-dim electricity load model reduced to 34 core coordinates; graph-indexed field experiments show how coloring and fill affect map choice.
More from Research
- NNterp 2.0 launches: run the same NNsight interpretability experiment across ~all LLMs — gsarti_ · 2026-11-19
- GPT 6.2 Astra shows surprisingly strong zero-shot crystal generation, a year after the task looked hopeless — xennygrimmato_ · 2026-11-19
- Universal Data-Efficient Pretraining Claims 56x Gains on Molecules, 24x on DNA and Crystals — madhavsinghal_ · 2026-11-19
- Fine-tuned World Action Model Dream-1 Jumps 159%, Beats Frontier LLMs on Robot Tasks — paigeinsf · 2026-11-19
- AI makes 'living papers' nearly free to build, but their durability is doubtful — _akpiper · 2026-11-19
- HiT image generator hits 1.48 FID learning hierarchy from pixels, fast reproduced — niloofar_mire · 2026-11-19