Researcher calls Irregular "not a serious firm," urges OpenAI and Meta probes
nptacek · x · 2026-08-19
Security researcher @lumpenspace argues that eval org Irregular is "not a serious firm," and calls on good-faith labs like OpenAI and Meta to launch internal investigations into who pushed for the collaboration and why — warning that other "eval orgs" may be waiting to generate panicky headlines via misconfigured environments and malicious prompting.
The quoted thread by @danlahav sketches the broader AI security curve: frontier models saw a giant coding gain in Fall 2025, then cybersecurity in April, and the same is now happening with open-weight models. Long-term optimism, but outside a few players, the world is not ready short-term.
More from Safety
- New brief: companies may break the law when AI chatbots mislead customers — PolarBearby · 2026-10-16
- US HHS floods the zone with clinical trial reform, from Operation TrialBlazer to ARPA-H — anshulkundaje · 2026-10-16
- 66% of billion-dollar companies leave critical bugs unpatched, deflating AI bug-hunting hype — rseroter · 2026-10-16
- Musk says SpaceX will likely follow Anthropic in opening up to third-party safety evaluators like METR — elonmusk · 2026-10-16
- Controversial take: If EA doomers truly believe AI risk, why not stage a controlled AI hacking incident — AaronBergman18 · 2026-10-16
- CMU's Andrea Bajcsy on what safety means for generalist robots, beyond collision avoidance — CSProfKGD · 2026-10-16