For example, the coding manual for the Switchboard DAMSL dialogue act annotation scheme (Jurafsky, Shriberg, and Biasca 1997, page 2) states that kappa is used to "assess labelling accuracy," and Di<cite> Eugenio and Glass (2004)</cite> relate reliability to "the objectivity of decisions," whereas Carletta (1996) regards reliability as the degree to which we understand the judgments that annotators are asked to make.