Economists Crowdsource Digitization of India's 70 Years of District Census Handbooks

Economist Paul Novosad's team has launched a crowdsourced project to fully collect, digitize, and make publicly available the District Census Handbooks from every Indian census since 1951 (up to roughly 2011); about 75% of the handbooks have been gathered so far. Led by UCLA PhD student Arun Ramesh and team member @arysriv, the project uses AI to coordinate the crowdsourcing workflow, with the goal of putting independent India's economic history truly into the public's hands.

Confirmed

• The handbooks go far beyond demographic statistics: they contain village-level public goods, socioeconomic data such as irrigated land, and extensive narrative records of economic and cultural life—for example, the Gobind Sagar reservoir submerged 371 villages (256 of them in Bilaspur district), and the handbook details the economic benefits while saying little about the original residents; the handbooks also include import-export tables for various cities along with trade, industry, and commerce data.
• The project has three phases: first, collect all handbooks and release them publicly (the current stage); second, categorize and digitize the contents; third, link the data across censuses (aligning district boundaries and linking over time), producing data that anyone can pull and use at any time.
• The team is publicly soliciting leads on missing volumes: libraries with holdings are invited to check their catalogs, report missing districts, or send their holdings lists directly; if scanning is the only way to make materials available, the team is willing to scan physical copies themselves.
• The team notes that coordinating large-scale workflows used to be nearly unbearable, but AI now lets them aggregate crowdsourced results, and they welcome researchers already working with related materials to join.

Why it matters

• The project turns seventy years of scattered, hard-to-use district-level archives into searchable, cross-period open data, providing village-level panel data infrastructure for research in development economics and Indian economic history.

2026-11-09 ~ 2026-11-09 · 11 related posts

• Economists crowdsource digitizing India's 1951-2011 district handbooks with AI parsing — paulnovosad · 2026-11-09
• [source] Economists use AI to unlock 70 years of Indian district handbooks as data — paulnovosad · 2026-11-09
• [source] Using AI to coordinate crowdsourced workflows in a digitization project — paulnovosad · 2026-11-09
• The goal is simple: make independent India's economic history publicly accessible — paulnovosad · 2026-11-09
• Digitization team asks libraries to help find missing Indian district handbooks — paulnovosad · 2026-11-09
• Team offers to physically scan missing volumes of India's district handbooks — paulnovosad · 2026-11-09
• [source] India handbook digitization project: collect, digitize, then link across censuses — paulnovosad · 2026-11-09
• UCLA PhD student leads effort to digitize India's district handbooks with per-city trade data — paulnovosad · 2026-11-09
• India's digitized district handbooks reveal 371 villages submerged with little mention of residents — paulnovosad · 2026-11-09
• Economists digitize India's district census handbooks, using AI to coordinate crowd work — paulnovosad · 2026-11-09

1 near-duplicate retellings: paulnovosad