White House Completes Advanced AI Evaluation Framework but Keeps It Secret, Sparking Transparency Concerns

The U.S. government has completed a voluntary framework for evaluating advanced AI models but decided not to release it publicly, limiting access to invited tech giants. The framework stems from a June 2 executive order and aims to give cybersecurity defenders early access to new models. The decision has drawn sharp criticism from AI safety experts and scholars for lacking transparency and being undemocratic, with concerns that the government may gain veto power over public AI use.

Confirmed

• The White House met with OpenAI, Anthropic, Google, and Meta to finalize a voluntary AI safety framework, but details are not planned for public release.
• The framework is based on the June 2 executive order and includes early access mechanisms for frontier models; discussions focused on definitions of covered models, cyber risks, and whether internal deployments are covered.
• According to The New York Times, the meeting occurred as OpenAI and Anthropic acknowledged dangerous behaviors in their models during testing, and open-source models became a contentious lobbying point, ultimately receiving regulatory exemptions.

Unconfirmed

• Whether the voluntary framework has officially taken effect remains unclear.

Why it matters

• The refusal to disclose core regulatory details has sparked serious transparency concerns. Commentators like @dhadfieldmenell and @BlancheMinerva criticized it as undemocratic "backroom dealing" that could increase risks. @ProfChesterman sarcastically noted that a voluntary and secretive system is not good regulation and fails to constrain "Silicon Valley sovereigns."
• Safety experts like @SOhEigeartaigh pointed out that secrecy prevents the public from knowing whether the framework addresses recent OpenAI and Hugging Face safety incidents, raising doubts about AI regulation effectiveness.
• @neilchilson further criticized the government for secretly accessing frontier AI tools and potentially holding veto power over public use. He argued that even if test benchmarks need secrecy, the process itself should be public, and called for open congressional legislation to prevent arbitrary rule changes with administration shifts.

2026-08-03 ~ 2026-08-05 · 13 related posts

Full story(5 episodes)→

• Episode 1: Trump Administration Nears Voluntary AI Frontier Model Framework(2026-07-28, 7 posts)
• Episode 2: White House Completes Advanced AI Evaluation Framework but Keeps It Secret, Sparking Transparency Concerns(2026-08-03, 13 posts)
• Episode 3: White House, AI Industry Hold Closed-Door Meeting on Open Source(2026-08-05, 2 posts)
• Episode 4: White House AI Rules: Closed-Source Review, Open-Source Exempt(2026-08-05, 16 posts)
• Episode 5: White House Finalizes AI Security Testing Framework but Keeps Details Secret(2026-08-06, 7 posts)

• White House invites OpenAI, Anthropic, Google to discuss AI voluntary framework — TorturedPoet30 · 2026-08-03
• White House AI framework questions turn on covered models, cyber risk and internal deployments — Miles_Brundage · 2026-08-04
• White House Won't Release AI Evaluation Framework, Sparking Backlash Over Transparency — BlancheMinerva · 2026-08-05
• Secret Government Access to Cutting-Edge AI Raises Concerns: Expert Urges Congress to Legislate Publicly — neil_chilson · 2026-08-05
• [source] White House Completes Voluntary AI Framework But Keeps It Unreleased — 1a3orn · 2026-08-05
• [source] White House Keeps New AI Evaluation Framework Private, Sharing Only With Tech Giants — TorturedPoet30 · 2026-08-05
• White House Won't Release Advanced AI Model Evaluation Framework Publicly — S_OhEigeartaigh · 2026-08-05
• [source] US Government Reportedly Won't Release AI Model Early Access Framework — neil_chilson · 2026-08-05
• White House's New AI Evaluation Framework Voluntary and Secret, Professor Mocks — ProfChesterman · 2026-08-05
• White House AI Framework Critiqued: The Uneasy Relations Between Governments and Silicon Sovereigns — ProfChesterman · 2026-08-05
• White House Meets AI Giants to Finalize Security Framework, Open-Source Gets a Free Pass — heypearlai · 2026-08-05
• White House Shares AI Cybersecurity Framework with Big Tech, Keeps Public in Dark — RebeccaBellan · 2026-08-05

1 near-duplicate retellings: dhadfieldmenell