Conditional Supervised Contrastive Learning for Fair Text Classification
Contrastive representation learning has gained much attention due to its
superior performance in learning representations from both image and sequential
data. However, the learned representations could potentially lead to
performance disparities in downstream tasks, such as increased silencing of
underrepresented groups in toxicity comment classification. In light of this
challenge, in this work, we study learning fair representations that satisfy a
notion of fairness known as equalized odds for text classification via
contrastive learning. Specifically, we first theoretically analyze the
connections between learning representations with fairness constraint and
conditional supervised contrastive objectives. Inspired by our theoretical
findings, we propose to use conditional supervised contrastive objectives to
learn fair representations for text classification. We conduct experiments on
two text datasets to demonstrate the effectiveness of our approaches in
balancing the trade-offs between task performance and bias mitigation among
existing baselines for text classification. Furthermore, we also show that the
proposed methods are stable in different hyperparameter settings.