Ant Group open-sources SingProbe, an in-model safety guardrail adding <0.5% decode overhead
智东西 · wechat · 2026-09-16
Ant Group's AI safety lab open-sourced SingProbe, an endogenous safety guardrail that runs alongside model generation, releasing code, models, and the SingStreamBench streaming-safety benchmark.
- Runtime probes reuse internal signals from inference to score user intent, answer safety, and hallucination risk in real time, enabling alerts or abortion before generation completes
- Adapted to 29 mainstream open models (Ling-3.0, GLM-5.2/5.3, Qwen, DeepSeek V4) and integrated with SGLang and vLLM
- Measured decode overhead below 0.5%; the flash variant beats public baselines on safety classification and streaming detection
- SingStreamBench measures when risks appear and how quickly they're caught
- A medical variant corrected 25.03% of baseline errors on AntAngelMed-100B via on-demand intervention
Related event: Ant Group Open-Sources SingProbe, an Intrinsic LLM Safety Guardrail(3 posts)→
More from Safety
- Cryptographers push back: claims ECC is likely to break are not consensus — jedisct1 · 2026-11-02
- UK's 'AI sovereignty' push undermined by its own energy and copyright policy — NinaDSchick · 2026-11-02
- Auditing my MCP credential broker: the worst hole was the config file — Relevant_Mousse_9117 · 2026-11-02
- Cambricon co-founder urges shared US-China AI ethics standards for leading models — pstAsiatech · 2026-11-02
- Vitalik's "post-AI cryptography": pseudonyms are dead, per-action anonymity is in — devanshmehta · 2026-11-02
- 6 prompts to see what ChatGPT quietly knows about you — and wipe it — Aiden_Tech_Ai · 2026-11-02