Latent Augmentation Improves Graph Self-Supervised Learning
Graph self-supervised learning has been vastly employed to learn
representations from unlabeled graphs. Existing methods can be roughly divided
into predictive learning and contrastive learning, where the latter one
attracts more research attention with better empirical performance. We argue
that, however, predictive models weaponed with latent augmentations and
powerful decoder could achieve comparable or even better representation power
than contrastive models. In this work, we introduce data augmentations into
latent space for superior generalization and better efficiency. A novel graph
decoder named Wiener Graph Deconvolutional Network is correspondingly designed
to perform information reconstruction from augmented latent representations.
Theoretical analysis proves the superior reconstruction ability of graph wiener
filter. Extensive experimental results on various datasets demonstrate the
effectiveness of our approach.