New health-time-series benchmark shows LLMs lag behind classic ML baselines

yang_yuzhe · x · 2026-07-22

The post recommends a paper on benchmarking LLM reasoning over health time series, with several non-obvious findings.

• The work argues that health evals have lagged behind model progress.
• It compares LLMs against SOTA machine-learning baselines, which the author calls the real baseline in these settings because they are cheaper and usually more explainable.
• The benchmark is framed as a “living ecosystem” with standard contribution paths.
• One interesting result mentioned is a reverse correlation between signal frequency and LLM performance.
• The paper also surfaces specific health areas where LLMs underperform.

Original post →

More from Research

• Diamandis: AI Cancer Navigator and $100 Genome Sequencing Close the Care Gap — PeterDiamandis · 2026-10-27
• EMNLP Oral: training-free Nexus Sampling cuts KV-cache memory 10x; OpenResearcher tops BrowseComp-Plus at 54.8% — yuz9yuz · 2026-10-27
• ICML 2026 position paper: LLM 'thinking traces' are a harmful anthropomorphism — rao2z · 2026-10-27
• Forking gap follows a power law in context frequency; masking rare n-grams shrinks it — ZimingLiu11 · 2026-10-27
• How forking happens: n-gram tables split logits into non-interacting subspaces — ZimingLiu11 · 2026-10-27
• The best LoRA explainer video yet: rank constraints meet intrinsic dimension — sophiamyang · 2026-10-27

Research channel →