Config says 8192, model card says 512: which run produced the long-context number?

AIQuanting · x · 2026-09-21

AIQuanting questions a model's long-context claims: maxpositionembeddings reads 8192 in config, but the model card's context row says 512, the agent config serves maxlen 512, and laya-multilingual / laya-typed-decisions are listed at 1024. 'Which run gives the long-context number?' — a concrete challenge to inconsistent long-context marketing.

Related event: Debate over ModernBERT long-context: sliding-window layers and 8192 limit questioned(5 posts)→

Original post →

More from Models

Models channel →