People once thought GPT OSS had no pretraining and was just distilled

nrehiew_ · x · 2026-07-21

A tongue-in-cheek reminder that when GPT OSS launched, many people were convinced it had skipped pretraining entirely and was just directly distilled.

The post is mostly a nostalgia joke about how quickly the community jumped to a mistaken interpretation of the release.

Original post →

More from Fun

Fun channel →