Swapping the Gaussian Process for an LLM in Bayesian optimization, benchmarked 4 ways
tak3sh8 · x · 2026-09-21
Developer Naman Gupta blogged an experiment replacing the Gaussian Process surrogate in Bayesian optimization with an LLM agent: instead of fitting a math function, the LLM reads all prior experiment records to make reasoning-driven guesses. Using a hot-sauce recipe as the motivating example, he benchmarks four setups — classical Bayesian optimization, LLM-only, a hybrid of both, and a human-in-the-loop agent with a reliability layer before acting on decisions.
More from coding & agent
- Ex-Stripe Exec: Ready Your Business for Agent Buyers With Checkout, Payment Element and Invoices — jeff_weinstein · 2026-09-21
- Dev clones Jev by LoRA-tuning Qwen3.5 4B on 25M synthetic tokens for $2 GPU hours — nato_nob · 2026-09-21
- Same prompt showdown: ChatGPT vs Claude vs Figma Make — Tegadesigns · 2026-09-21
- Google's Agent Substrate detailed: AX app layer on managed agentic compute infra — rakyll · 2026-09-21
- After 15 years of better dashboards, agents can now execute finance transactions themselves — LexSokolin · 2026-09-21
- Why sandbox-as-a-service startups are booming — and whether labs will just build it themselves — dejavucoder · 2026-09-21