A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithms
This work seeks to center validity considerations in deliberations around
whether and how to build data-driven algorithms in high-stakes domains. Toward
this end, we translate key concepts from validity theory to predictive
algorithms. We describe common challenges in problem formulation and data
issues that jeopardize the validity of predictive algorithms. We distill these
issues into a series of high-level questions intended to promote and document
reflections on the legitimacy of the predictive task and the suitability of the
data. This contribution lays the foundation for co-designing a validity
protocol, in collaboration with real-world stakeholders, including
decision-makers, modelers, and members of potentially impacted communities, to
critically evaluate the justifiability of specific designs and uses of
data-driven algorithmic systems.