Task-specific NLP comeback: ScaleDown's CDM claims 200x speed, 467x cost savings

量子位 · wechat · 2026-10-18

Task-specific small language models are having a moment. ScaleDown launched CDM (constrained decoding), a trio of models for classification, entity extraction, and summarization that skip token-by-token generation and return structured results directly — claiming up to 200x speed and 467x cost savings vs frontier APIs, 1M-token text/image input, and pricing of $0.05 per million input tokens with free output. Earlier ScaleDown benchmarks showed 8-9% higher accuracy than Claude/GPT/Gemini at a fraction of the cost; the company has raised $24.5M led by Khosla Ventures.

Rival Jev (TypeSafe AI) shipped v1.14.0: multimodal image input (actually present since 1.13), a Box output type for object localization, multilingual improvements, and experimental long context. On DecisionBench, CDM scores 77.2% vs Jev's 72%. The trend: as AI apps scale, cost, latency, and output stability are reviving classic NLP tasks as dedicated model services.

Original post →

More from Models

Models channel →