PACT benchmark launches for enterprise assistant compliance; open-weight models top the board
baseten · x · 2026-09-01
Baseten is sponsoring PACT (Pressure-Applied Compliance Testing), a new benchmark for enterprise assistant rule-following in regulated domains such as HIPAA, hiring law, and GDPR, in partnership with Decagon.\n\nThe two highest-scoring models are open-weight. GLM-5.3 and GLM-5.3-Flash are the best-performing GLM models, ranking #5 and #8 overall.
Related event: PACT Benchmark Tests Enterprise AI Assistants Under Pressure(2 posts)→
More from Research
- Fei-Fei Li's World Labs releases Atlas, a multimodal world model with pixel-perfect camera control — Chris_Armstrong · 2026-09-02
- Paper Shows On-Policy Distillation Gains Come from Self-Improvement, Not Teacher Guidance — _akhaliq · 2026-09-02
- The World Labs Introduces Atlas: Pixel-Perfect Camera Control World Model — Scobleizer · 2026-09-02
- 4DAnyone on Gradio: Optimized for <32GB VRAM, 8x Faster — _akhaliq · 2026-09-02
- Meta's Muse Voice Transcribe Balances Speed and Accuracy with Adaptive Delay — AIatMeta · 2026-09-02
- Speculative PTC: Overlapping tool calls with code generation for faster agents — a1zhang · 2026-09-02