Meta Researchers Release WearableQA, a 4,084-Question Benchmark for LLM Health Reasoning
iScienceLuvr · x · 2026-09-08
Meta researchers introduce WearableQA, a benchmark for evaluating LLMs on reasoning over longitudinal wearable data.
- Built from 200 real users' wearable records: hundreds of days per person across 16 daily metrics, plus a 17-biomarker blood panel and demographic info
- 4,084 multiple-choice questions total
- Two axes: data reasoning (trends, anomalies, relationships from raw measurements) and health reasoning (clinical interpretation)
The work addresses the lack of systematic evaluation as LLMs are increasingly used to analyze longitudinal wearable data for personalized medicine.
More from Research
- Deep Learning Course Adds Mechanistic Interpretability Lecture This Winter — CSProfKGD · 2026-10-26
- INCLUDE-2.0 benchmark evaluates regional knowledge across 91 languages and 86 countries — ABosselut · 2026-10-26
- CoRL paper: flow-matching VLAs can run 1-step Euler inference with no retraining — kaixhin · 2026-10-26
- CoVer at EMNLP 2026: Training Code LLMs to Generate and Self-Verify Simultaneously — algo_diver · 2026-10-26
- Robotic dexterity should be judged on speed, force control and tool use, not copying humans — DJiafei · 2026-10-26
- Turing-complete malware can run in PyTorch's backward pass via a zero-valued loss — retr0jirachi · 2026-10-26