DeepMind and Partners Announce Up to $10M Funding Call for Multi-Agent AI Safety Research
weballergy · x · 2026-08-21
Google DeepMind, together with Schmidt Sciences, the Cooperative AI Foundation, and ARIA, supported by Google.org, has announced a technical research funding call of up to $10M for researchers worldwide on multi-agent AI safety.
Context and motivation:
- A decade of safety work focused on individual models, but AI is entering an era where millions of agents built by different organizations will communicate, negotiate, and transact across digital environments.
- Large interacting agent groups can suddenly produce emergent collective behaviors that current tools cannot predict, measure, or monitor; most safety evaluations still analyze models in isolation.
- The call targets how large-scale multi-agent systems behave as groups and frameworks to understand and mitigate risks — the "invisible" safety risks arising when independent systems interact.
The poster (@weballergy) notes this is an active research area on their end, invites the broader community to work on it, and admits no real-world system fully meets the spec yet — many subproblems remain, especially in valuable real-world scenarios.
More from Safety
- Vector Institute partners with Town of Caledon in its first municipal AI adoption deal — VectorInst · 2026-10-16
- 'Most dangerous technology in the world' put in toddler sandboxes, and we're surprised when it escapes — KevinNaughtonJr · 2026-10-16
- NYC Comptroller urges Anthropic to pause IPO until AI safety and governance concerns are addressed — ShakeelHashim · 2026-10-16
- Dwarkesh: Anthropic insider expects AI to match humans at AI research within 9 months — ShakeelHashim · 2026-10-16
- Anthropic and Gray Swan launch $300,000 indirect prompt injection red-teaming contest — bcherny · 2026-10-16
- Experts: AI's nearer bioweapons risk is amplifying capable actors, not enabling amateurs — HaydnBelfield · 2026-10-16