SGD doesn't inherit the Bayesian identity — summed losses are a prequential score
BlackHC · x · 2026-09-09
A caveat from the thread: SGD doesn't inherit the Bayesian identity. Summing first-pass losses depends on the specific pipeline and data order — it's a prequential score, not Bayesian evidence. But the geometry and considerations carry over to ordinary training runs.
More from Research
- New arXiv paper recasts Legendre-Fenchel transform as quadratic polarity in projective geometry — FrnkNlsn · 2026-09-09
- Michael Levin's Controversial Platonic Space Paper Clears Peer Review — drmichaellevin · 2026-09-09
- New COLM Paper: AI Agent Swarms Can Split Attacks Across PRs, Making Oversight Far Harder — ronbodkin · 2026-09-09
- ExecCritic: test-verify-revise RL scaffold lifts Qwen3.5 on SWE-bench from 61.2% to 72.6% — SharonYixuanLi · 2026-09-09
- Frontier models ace counterexamples but lag on closed-form math, benchmark designer notes — evijit · 2026-09-09
- Google and HHMI release complete wiring diagram of the male fruit fly nervous system — GoogleAI · 2026-09-09