What Is Fairness? Implications For FairML
A growing body of literature in fairness-aware ML (fairML) aspires to
mitigate machine learning (ML)-related unfairness in automated decision making
(ADM) by defining metrics that measure fairness of an ML model and by proposing
methods that ensure that trained ML models achieve low values in those
measures. However, the underlying concept of fairness, i.e., the question of
what fairness is, is rarely discussed, leaving a considerable gap between
centuries of philosophical discussion and recent adoption of the concept in the
ML community. In this work, we try to bridge this gap by formalizing a
consistent concept of fairness and by translating the philosophical
considerations into a formal framework for the evaluation of ML models in ADM
systems. We derive that fairness problems can already arise without the
presence of protected attributes, pointing out that fairness and predictive
performance are not irreconcilable counterparts, but rather that the latter is
necessary to achieve the former. Moreover, we argue why and how causal
considerations are necessary when assessing fairness in the presence of
protected attributes. Eventually, we achieve greater linguistic clarity for the
discussion of fairML by clearly assigning responsibilities to stakeholders
inside and outside ML.