Statistician: Three Systemic Incidents in One Month Is Enough to Reject Low Base Rate (p=0.002)

wfithian · x · 2026-11-17

Pushing back on "n=3 tells us nothing," statistician William Fithian argues that if such events follow a Poisson distribution, n=3 in a single month rejects a base rate of ≤0.25 occurrences/month at p=0.002 — you'd wait nearly 40 years on average to see such a month, yet AI cyberattacks have only been a major concern for two months.

He cautions that a rising or correlated rate doesn't prove AI involvement; an unknown common cause is possible. He endorses systematically tracking mysterious configuration errors with system-wide impact to test for statistical abnormality.

Original post →

More from Safety

Safety channel →