Gemma 4 creative writing woes: every 26B finetune makes characters sound identical

Whydoiexist2983 · reddit · 2026-10-26

A local-model user reports frustration running Gemma 4 26B finetunes (MeroMero, Melody1437, Kitchoon, heretic, StyleTune and more) for creative writing: every variant produces characters with the same voice, and prompt tweaks or feeding 25 dialogue examples generated by another model had no effect.

They share a concrete failure case — a character's hand "melting" through a shield, explained away with the line "Your biology reacted to me" — and describe their dilemma: older 12B models lack world knowledge while 24B models run at only 5 tokens/sec, so it's either rewriting slop or accepting limited knowledge.

Original post →

More from Fun

Fun channel →