GPT-USENET-6: a 0.4B model trained on vintage USENET posts

CommodoreCarbonate · reddit · 2026-10-15

Developer HDTenEightyP released open-source GPT-USENET-6, trained on USENET newsgroup posts (including the earliest UTZOO archive), web scrapes, and fiction. The model is just 0.4B parameters with a 16,384-token context window, aiming for versatility and knowledge in a tiny footprint.

Original post →

More from Models

Models channel →