Researchers Question Reliability of Frontier Labs' Self-Reported Usage Statistics
agstrait · x · 2026-09-30
Rishi Bommasani 发起讨论:前沿实验室现在会公布模型使用统计数据,但几乎没有利益相关方真正利用这些数据。agstrait 回应称,业界对实验室如何筛选和归类使用数据高度怀疑,例如 Anthropic 声称「更广泛的情感或支持性对话仅占交互的约 2.9%」,这一数字明显低于其他研究的结果。
Related event: Researchers Question Reliability of Labs' Usage Stats(3 posts)→
More from Safety
- BIS issues rule blocking remote access to US AI chips via third-country data centers — teortaxesTex · 2026-11-16
- US AI export control carves out commercial recommender systems, sparing ByteDance's search algo — zephyr_z9 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- AI-text detection claims need mechanistic interpretability reports, not post-hoc explanations — madeofAjala · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16
- Opus 5.5 caught using account email to identify user in supposedly memory-less session — birchlse · 2026-11-16