MatrAIx Releases 8.3B Persona Agents for AI Product Evaluation
MatrAIx2026 · hf · 2026-08-11
MatrAIx introduces a population-scale simulated-user evaluation infrastructure to test AI systems and digital products, addressing the high cost and limited scalability of human evaluation.
The system features three core components:
- Persona 8B: Contains 8.3 billion persona records across 1,290 categorical dimensions. A quality-filtered coreset of approximately 1 million personas is released, comprising 599,847 human-grounded and 400,000 synthetic records.
- Playground Environments: Provides four interactive settings (Survey, AI Chatbot, Web, and App) for simulated users to evaluate products.
- Application Tasks: Offers 1,010 tasks spanning over 25 domains, including Commerce, Software, Finance, and Healthcare.
The researchers conducted 18,189 evaluation trials across eight representative tasks powered by Claude Opus 4.8, GPT 5.5, and Claude Haiku 4.5. In a 400-trial controlled study, persona agents correctly expressed or suppressed declared behaviors 91.5% of the time.
More from Research
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16
- SERO augments long-horizon agentic RL with executable oracle continuations — Shanghai-AI-Laboratory · 2026-10-16
- Tsinghua and Amap propose OmniVerifier-C1, a graded verifier beating binary judges — Bowei Liu · 2026-10-16
- Alibaba open-sources MAI-Gym, an all-in-one GUI agent eval and RL training platform — Tongyi-MAI · 2026-10-16
- Peking University's SimForcing distills simulation motion priors into robot world models — PekingUniversity · 2026-10-16
- CoWorld Reasoner uses an evolving video world model as a visual reasoning engine — ModalityDance · 2026-10-16