4B decision model trained on 117k examples matches Jev — except it can't detect sarcasm

SRSchmidgall · x · 2026-10-31

askalphaxiv, working with OpenResearch, trained a 4B decision model on over 117k decision-making examples. It performs practically identically to Jev across the board — except in sarcasm detection, a persistent failure mode. Notably, during evals the model generalized to unseen tasks like hate-speech severity, emotion detection, and intent classification.

Original post →

More from Research

Research channel →