Indie researcher pauses RNN training over environment bugs, shifts to FunSearch-style tasks
cephaloform · x · 2026-11-12
An independent researcher halted RNN training early after finding issues in the training environment and is splitting it up for safety. Next steps: optimizer engineering, curriculum ordering, auxiliary loss design, plus more FunSearch-style tasks like bin packing, maxcut, and sorting networks — "the ones that weren't busted worked sorta." Updates are slow because he's CPU-only: the first full test run takes about a week, and a longer one about a month.
More from Research
- 200-seat UC Berkeley course on full-stack post-training, RL and applied RSI announced — karinanguyen · 2026-11-12
- NVIDIA's Déjà View: 117M looped transformer matches models 10x larger at 3D reconstruction — NVIDIAAI · 2026-11-12
- OpenAI finds models are getting harder to monitor through their chain-of-thought — xiamengzhou · 2026-11-12
- Show Reddit: ge, a Rust GGUF engine, benchmarks against llama.cpp on a 4GB RTX 3050 — Raptor2496 · 2026-11-12
- 1,500 AI-for-Science Papers in a Week Share One Question: Compared With What? — bravo_abad · 2026-11-12
- AI system proves longstanding quantum computing conjecture in three days, Lean-verified — _arohan_ · 2026-11-12