Characterizing Measurement Error in Human Rights


Oona A. Hathaway & Daniel E. Ho

Abstract

We illustrate a method for accounting for measurement error in human rights studies -- an area of research plagued by difficulties of measuring concepts that cannot be directly observed. We focus on the widely used Purdue Political Terror Scales (PTS), which quantify political terror experienced in a country based on independent qualitative narrative reports compiled by the United States Department of State and Amnesty International. A simple Bayesian measurement model systematically incorporates these two independent codings and directly models the uncertainty of a latent measure of political terror. This reveals that attenuation bias due to lagged PTS estimates can be severe, leading conventional estimates to be conservatively biased by an absolute order of roughly two. Substantively, this means that explanatory variables such as democracy may have roughly twice the impact on human rights as currently believed. We conclude that measurement methods illustrated here hold much promise for addressing concerns about measurement error in empirical scholarship.


Download Manuscript



Daniel E. Ho
Last changed: