Gadsby-4B Hits Hugging Face: Constrained Decoding Turns Gemma 3 4B Into a Lipogram Model

cephaloform · x · 2026-10-12

erinbeess released Gadsby-4B on Hugging Face, a finetune of google/gemma-3-4b-it built for lipogram writing using constrained decoding and rejection sampling. The author notes the raw model often degenerated into spamming random words, so they ran SFT on more coherent responses. A comparison screenshot shows Gadsby's over-the-top style versus base Gemma's plain answer about octopus hearts.

Original post →

More from Models

Models channel →