llm-drift-bench: An Open-Source Tool to Catch What Breaks When You Swap Models
Worldly-Knowledge-90 · reddit · 2026-11-13
作者发布 llm-drift-bench v0.1.0:输入新旧模型保存的响应,自动输出具体差异,如丢失的 JSON 字段、错乱的数字、文本变动。仅基于已保存的 JSON/文本运行,无需 GPU 或 API key,方便在切换模型或降量化前快速排查回归问题。作者同时征求社区真实踩坑案例以扩充测试集。
Related event: Open-source llm-drift-bench compares outputs before and after model swaps(2 posts)→
More from coding & agent
- Nursa's accountant and retired parole officer built real tools with AI — every · 2026-11-14
- We don't need more chatbots: an agent harness lead's field notes — threepointone · 2026-11-14
- Nexus launches an AI context engine that turns deployment knowledge into agent-queryable graphs — rohanpaul_ai · 2026-11-14
- Developer now runs 100% of his agents locally on a Mac Mini, up from 25% earlier this year — josh_bickett · 2026-11-14
- Mediabunny ships 400 fixes from an LLM-assisted bug hunt across its 20M-download codebase — Vjeux · 2026-11-14
- Perplexity Teammates screenshot shows agents on Datadog duty, reading PRs overnight — testingcatalog · 2026-11-14