BabaBench: new healthcare-coordination benchmark shows frontier AI still can't replace human care coordination
aidangch · x · 2026-10-15
Healthcare coordination company Baba released BabaBench, measuring how frontier models handle real coordination work—earning the trust of a Spanish-speaking diabetic patient, walking her through a Medicaid application, finding secure housing, and nudging better choices along the way.
The synthetic worlds are built from annotations by hundreds of in-house doctors, therapists, nurses, and social workers. Conclusion: AI alone isn't ready to replace human care coordination.
More from Research
- Five-year Harvard postdoc preprint unveils BARRACUDA for systematic synthetic circuit design — NikoMcCarty · 2026-10-15
- Autonomous LLM agents for materials science: seminar at Texas Southern University — Fowe · 2026-10-15
- Behavioral Self-Rewarding lifts Qwen3-14B to 34.7% on SWE-bench Verified — dair_ai · 2026-10-15
- vLLM adaptive verification now works head-free, using draft logits with online logistic calibration — vllm_project · 2026-10-15
- New arXiv paper: thousands of ML models poorly predict hundreds of life outcomes — RobbWiller · 2026-10-15
- Frontier models are felling decades-old open problems across math, physics and chemistry — IgorCarron · 2026-10-15