Towards Bridging Algorithm and Theory for Unbiased Recommendation
This work studies the problem of learning unbiased algorithms from biased
feedback for recommender systems. We address this problem from both theoretical
and algorithmic perspectives. Recent works in unbiased learning have advanced
the state-of-the-art with various techniques such as meta-learning, knowledge
distillation, and information bottleneck. Despite their empirical successes,
most of them lack theoretical guarantee, forming non-negligible gaps between
the theories and recent algorithms. To this end, we first view the unbiased
recommendation problem from a distribution shift perspective. We theoretically
analyze the generalization bounds of unbiased learning and suggest their close
relations with recent unbiased learning objectives. Based on the theoretical
analysis, we further propose a principled framework, Adversarial Self-Training
(AST), for unbiased recommendation. Empirical evaluation on real-world and
semi-synthetic datasets demonstrate the effectiveness of the proposed AST.