antirez: Calling classifiers 'decision models' is a crime against machine learning

antirez · x · 2026-10-03

SQLite creator antirez pushed back on calling classifiers "decision models," arguing it's a misreading of machine learning. His core point: these models decide far less than LLMs, since chain-of-thought can be seen as serial information processing that classifiers lack. Such models are either small LLMs that aren't allowed to think (using logits at the last prefill position to categorize) or BERT-like models that compress input meaning and project a class — in both cases deciding much less than an LLM.

Original post →

More from Models

Models channel →