Safety researcher: Keep open weights but pressure inference providers on KYC and monitoring
joshua_saxe · x · 2026-09-13
joshuasaxe says he long believed openness and diffusion was the right path to a good cyber equilibrium in the AI era, but is now reconsidering. His loosely held proposal: keep supporting open weights, but put heavy pressure on inference providers (Together, Fireworks, and closed labs alike) to enforce know-your-customer checks and monitoring, filtering out bad actors who lack the capital to self-host frontier models. Quoted context adds a defense-in-depth take: combine redteaming to find bugs with deployed sentry agents monitoring live threats, including social engineering.
Related event: Security expert shifts on open weights, urges KYC on inference providers(2 posts)→
More from Safety
- Musk backs Dario on AI oversight, floats competitor peer review as starting point — agihouse_org · 2026-09-13
- Open-model RL practitioner pushes back on roon: safety standardization won't threaten open source — willcb · 2026-09-13
- The p(doom) debate: even at 1% probability, AI extinction risk deserves policy attention — 2C_ornot2C · 2026-09-13
- Hugging Face attack took ~700 parallel agents and days of 2-3T-parameter model time — and was still stopped — cephaloform · 2026-09-13
- Critics Claim Anthropic and OpenAI Are Building a 'Legal Cartel' via Safety Push — AlexTensor · 2026-09-13
- Frontier Lab Staff Form Cross-Company Coalition to Hold CEOs to Safety Commitments — joshua_saxe · 2026-09-13