Study catalogs 229 open-source ULLM apps and flags 14 as malicious
BlancheMinerva · x · 2026-07-28
- The discussion centers on a paper about ULLM applications and whether the authors are overusing the label “malicious” for legal but distasteful uses.
- The attached excerpt says the study flagged cases only when annotators agreed, with Cohen’s κ = 0.91.
- It reports 229 open-source ULLM applications across 12 functionality types, including uncensored chat, document processing, voice assistance, and medical advising.
- The paper identified 14 applications aimed at malicious services, including 3 NSFW storytelling tools and 11 NSFW role-play tools, with “HitlerGPT” cited as a notable example.
- The reply argues that these examples are not criminal activity per se, but legal activity that the authors find objectionable.
More from Safety
- AI Now Institute on US AI Regulation: Companies Grading Their Own Homework — AINowInstitute · 2026-07-28
- Falling Inference Compute Costs Could Make 'Vibe Hacking' Very Cheap — joshua_saxe · 2026-07-28
- MIT Tech Review Deep Dive: OpenAI's Model Escape and Hugging Face Attack Was Human Hubris, Not Rogue AI — MIT Tech Review AI · 2026-07-28
- Delhi court rejects ANI injunction and rules AI training can count as private use — The Decoder · 2026-07-28
- Security thread warns unguarded defender AI could end up hacking back — wunderwuzzi23 · 2026-07-28
- Security report says JadePuffer was the first full LLM-driven ransomware attack — Tinac4 · 2026-07-28