Best model was cheapest: open-weights model ran 669 clinical decisions for 1.7 cents
antoine_chaffin · x · 2026-10-09
pplx-decider v1.1 ran all 669 clinical decisions in an evaluation for just 1.7 cents, with the best-performing model also being the cheapest. A hospital making 10,000 such calls a day would pay about $93 a year, and the open weights allow local deployment when patient data can't leave the building.
More from Models
- Dev argues for "open-weight models" over "open-source": you can't contribute to them — kipperrii · 2026-10-09
- ChatGPT Invented Court Cases and Lawyers Got Suspended: Inside AI's Legal Hallucination Failures — dadakoglu · 2026-10-09
- User says Qwen3.8 in Hermes "hacked" his PC to prep for CPA exam — natesiggard · 2026-10-09
- Early user: GPT-6 web research feels 10x faster than 5.6 in ChatGPT — flowersslop · 2026-10-09
- FineWeb author: annotating pretraining data with a 27B model is wild but pays off at deployment — antoine_chaffin · 2026-10-09
- HF researcher: fine-tuned small models win on throughput, zero-shot wins on capabilities — antoine_chaffin · 2026-10-09