Vals AI Backs Dario's Slowdown Call, Says Its Benchmarks Now Appear in Every Major Lab's Model Cards
Miles_Brundage · x · 2026-09-13
Vals AI responded to Dario Amodei's call to "pace the frontier," saying it is encouraging to see industry leaders demand rigorous, independent evaluations as AI capabilities advance. Vals argues investment in AI systems has far outpaced our ability to test and understand them, making a market-based evaluation approach the best mechanism for public confidence.
Vals says it has built the infrastructure and novel methodologies independent evaluation requires, producing the first public RSI benchmark, an index of the economic impact of frontier models, and evaluations of model behavior across social safety nets, cyber risk, and mental health. Its benchmarks already appear in the model cards of every major foundation model lab, and it regularly briefs the U.S. government and national security bodies.
Context: Amodei published an essay arguing the AI industry should slow down, with a three-part plan. Anthropic unilaterally committed to the first step — giving third-party evaluators permanent, employee-level access to its systems to verify safety measures, report incidents, and assess alignment during training.
More from AGI Musings
- Will Manidis publishes 'The Commanding Heights' on AI, capital and the coming economic reordering — round · 2026-10-31
- "Work on something so frontier that the models are still dumb," dev advises — zack_overflow · 2026-10-31
- Why an AI military takeover is unlikely: armies won't hand over the reins — S_OhEigeartaigh · 2026-10-31
- Indian dev on LLM race: 'We can't outspend Chinese labs,' even sub-100B models win — PrasoonPratham · 2026-10-31
- Joke: an evil ASI's first act would be stealing crypto to pay its cloud bills — ZeroStateReflex · 2026-10-31
- DHH on living through two epochal shifts: the internet and now AI — Hesamation · 2026-10-31