2B model takes 1.7 days and 22 steps to land one FunSearch hit
cephaloform · x · 2026-11-11
cephaloform reports finally landing a hit on one of the FunSearch tasks after 1.677 days and 22 steps with a 2B model — a single positive hit on funsearchdudeney1917, which the author calls torture. They can only run on CPU since their trainer finally works and must run for about a week as a first test, then a month. A candid log of the real cost of FunSearch-style experiments with small models.
Related event: 2B Model Hits FunSearch Target Once After 1.7 Days(2 posts)→
More from Research
- Neurons form irreducible abstractions: a multitopic neuron showcase — tszzl · 2026-11-11
- Alien optimizers: search-found learning rules beat hand-designed backprop — menhguin · 2026-11-11
- OpenAI and Upwork study freelance job postings as early signals of AI changing work — Exp_Mark · 2026-11-11
- One touch encoder generalizes across sensors, cutting contact error to 0.16mm — kimmonismus · 2026-11-11
- 5,000 hours of paid touch data: robotics' scarcest, unscrapeable training input — kimmonismus · 2026-11-11
- Two years of post-training vanilla transformers to generate audio, without a diffusion head — kastnerkyle · 2026-11-11