NanoStories: 50M-story TinyStories-style dataset generated by rules in 10 minutes

Tall_Abrocoma_3533 · reddit · 2026-10-23

AuroraAI-Research released NanoStories on Hugging Face, a TinyStories-style dataset with 50M stories, about 25x the size of TinyStories. It was generated with a rule-based algorithm rather than a language model, taking under 10 minutes to produce and a few minutes on a phone CPU to convert to parquet and upload. Feedback welcome.

Original post →

More from Research

Research channel →