Forecaster David Manheim: define before you measure, AGI debates will look silly in a year or two

On September 16, David Manheim, a researcher in AI forecasting and risk, posted a series of threads on the term "AGI" and AI regulatory methodology. His core argument: define first, then measure—and regulation need not wait for precise definitions.

Confirmed

• Manheim reiterated a position he has held since 2019-2020: the forecasting community should stop using poorly defined terms like "AGI," otherwise measurement results are essentially meaningless. He cited a self-deprecating contrast: the forecasting community says "don't use vague words like AGI," while the AI community keeps using it.
• He also predicted that current AI capability trajectories will most likely continue—capabilities advancing unevenly but rapidly overall—rendering the AGI definition debate moot within a year or two as the answer becomes increasingly obvious.
• In exchanges with commenters (such as discussions relayed by averyfjames), responding to the objection that "regulation must first precisely define its target" (e.g., regulating nuclear reactors requires defining fission first), he pointed out that nations can absolutely regulate poorly delineated things: illicit drug control brings novel designer drugs under control by continually redefining categories; nuclear regulation starts by covering all radioactive materials, fissionable or not.

Why it matters

• This debate goes straight to the methodological foundations of AI governance: if "define before measuring" is a prerequisite for valid forecasting and evaluation, much of the current AGI-related benchmarking and timeline predictions may rest on shaky ground.
• The drug and nuclear examples show that regulation can take a broad-brush, dynamically-defined path—a pragmatic approach worth borrowing for AI policy where no conceptual consensus yet exists.

2026-09-16 ~ 2026-09-16 · 7 related posts

• [source] Forecasting community: stop using poorly-defined 'AGI' — define before you measure — davidmanheim · 2026-09-16
• [source] Researcher David Manheim: AGI definitional debates will look silly within a year or two — davidmanheim · 2026-09-16
• Define Before You Measure: The Case for Regulating Poorly-Scoped Tech — averyfjames · 2026-09-16
• [source] Regulation Doesn't Need Perfect Definitions: Lessons from Drugs and Nuclear Power — davidmanheim · 2026-09-16
• Poorly-Scoped Definitions Don't Block Regulation: Lessons from Drugs and Nuclear — davidmanheim · 2026-09-16
• David Manheim: all current systems fail AGI definitions; edge cases are what matter — davidmanheim · 2026-09-16
• Regulating AGI without a crisp definition: a false-positive tradeoff argument — davidmanheim · 2026-09-16