21K-Parameter Model Generates Business Emails, Trains Stably
SrijSriv211 · reddit · 2026-09-05
Reddit user SrijSriv211 shares Valentine-v0, a tiny model with only 21k non-embedding parameters (2 layers, 4 heads, 64 head dims, 170 FFN dim) trained on business email generation. Compared to their previous 300k-parameter Strawberry-email, Valentine-v0 has 7% of the parameters but achieves higher loss (2.1670 train / 2.2646 val vs 1.65/1.68). Examples show decent text generation for its size. A larger version, GitHub repo, and technical report are planned.
More from Research
- RL Hill-Climbing Creates Model Spikes, So Judge AI With Multiple Models — dejavucoder · 2026-09-05
- Study: Generative AI Has Already Cost Philippines' BPO Industry ~250,000 Jobs — sebkrier · 2026-09-05
- NTU Singapore to Host GDL2026 Conference on Geometry, Dynamics, and Learning, Sept 28-30 — FrnkNlsn · 2026-09-05
- Flow Reasoning Models hit 99.5% on Sudoku-Extreme with 44× fewer inference FLOPs — mark_k · 2026-09-05
- Conditional independence limits parallel token generation in masked diffusion models — alec_helbling · 2026-09-05
- Seven-minute chatbot conversation beats fact sheets at reducing conspiracy beliefs — The Decoder · 2026-09-05