A 16-neuron network learns the two-spirals task, visualized step by step
Single-Climate2259 · reddit · 2026-10-29
The author used the open model SenseNova 6.8 Code2Video to produce a step-by-step animation of a tiny 16-hidden-neuron network learning to separate two spirals. Each hidden neuron draws one straight line; over 2,000 weight updates the boundary barely moves at first, then bends, and by step 1,133 all 300 points are classified correctly — 16 weighted lines combining into a spiral boundary. All boundaries, readouts and weights come from a real training run, and the open-source model generates the full film including narration timing.
More from Research
- UC Berkeley's RaRE Shows Judge Ensembles Beat Single Judges in Rubrics-as-Rewards RL — YutongBAI1002 · 2026-10-29
- BallotBench pits 9 frontier AI agents against the 2026 midterms; GPT 6.1 alone picks Democrats — goyal__pramod · 2026-10-29
- 3DV2027 Decisions Go Out Today; Author Rebuttal Deadline Extended to Nov 2 — CSProfKGD · 2026-10-29
- Samaya's 3B-Parameter Sterling Beats Claude Fable 5.1 on Finance Benchmark at 11x Lower Cost — simonguozirui · 2026-10-29
- Discussion: Can language model critics become too predictable "deterministic parrots"? — IgorBrigadir · 2026-10-29
- Training a Small OSS Model on Factorio Tasks Could Be a Great Generalization Study — rmcwhorter99 · 2026-10-29