Two NeurIPS 2026 papers: margin conditions tame sequential task confusion
khademinori · x · 2026-09-25
Two papers accepted at NeurIPS 2026. The first proves that under a Mahalanobis margin condition on pretrained representations, task confusion between classes learned at different times decays exponentially in the margin, and that fine-tuning erodes the margin at a rate growing with the learning rate. The second gives a closed-form characterization of the per-stage offset L2 regularization induces in sequentially trained cross-entropy heads, introducing gauge anchoring.
More from Research
- Ross Girshick posts CVPR slides recounting 1.5 decades of object detection and its link to the LLM era — CatAstro_Piyush · 2026-11-11
- What it takes to squeeze performance: EMA, cosine scheduling and custom dead-cluster revival — chrisemoody · 2026-11-11
- Trainable JWST model boosts exoplanet sensitivity 2–15x in Nature paper — bravo_abad · 2026-11-11
- Ben Todd's alt log-log plot shows task horizons hitting a singularity in under 12 months — ben_j_todd · 2026-11-11
- Eva Jablonka's concept links aphantasia to the evolution of language — AnnaCiaunica · 2026-11-11
- BioAgent-DF: silent hardware faults can alter AI science agents' decisions invisibly — INTOSYN-AI-Labs · 2026-11-11