Citizen science labeling works better when small groups deliberate, not annotate alone

_akpiper · x · 2026-11-06

The author proposes a principle for citizen science projects: instead of having volunteers annotate independently, organize them into small online groups that discuss and reach consensus before producing labels.

The quoted post states the underlying finding: small groups that deliberate outperform the wisdom of crowds aggregated from independent judgments — the discussion itself improves label quality rather than simple averaging of many answers.

Original post →

More from Research

Research channel →