Training AI Researchers on Small Compute Risks Learning 'Anti-Bitter-Lesson' Habits

1a3orn · x · 2026-11-22

1a3orn discusses the risk of training research-capable AIs at small compute scale: models might learn a bunch of "anti-bitter-lesson" adaptations that transfer awfully to larger scales.

He adds a cost argument: even a minimal experimental run costs $1k–$10k (MATS-fellow scale), suggesting a 10^5-order floor on training compute cost — assuming models must learn to infer facts about large runs from much smaller ones. A possible sidestep: models getting good via theoretical math and insight rather than experiments.

Related event: Researchers Warn Small-Compute AI Researchers May Learn Anti-Bitter-Lesson Habits(2 posts)→

Original post →

More from AGI Musings

AGI Musings channel →