transformers merges 67-commit PR adding JEV + decision core, logic cut to templates + head loading

art_zucker · x · 2026-11-09

Hugging Face's transformers library merged PR #50054 (67 commits, by ArthurZucker) adding JEV + decision core to main. Key points: much of the logic previously living in remote code now boils down to chat templates plus head loading; DecisionHead classes were renamed to ForDecision with clef-only target capture moved out of core; decision heads now read the model passed to them, with decisionhead/ loaded from the decision repo, dropping cross-repo loading; configs use iscausal=False instead of usebidirectionalattention for qwen3.5 backbones; and encodemarkedchat computes its own marker pattern. The author hopes this helps people train better models.

Related event: Hugging Face transformers Adds Full Support for JEV Models(2 posts)→

Original post →

More from Models

Models channel →