Alignment and uniformity are validated by a set of theoretical and experimental analysis in [1]}. We summarize the key experiments as below: 1) the alignment and uniformity properties are statistically causally related with downstream task performances; 2) a direct optimization using the alignment and uniformity as a loss function can give comparable or better performances comparing with the performances obtained by optimizing the contrastive loss.
It can be inferred from the experimental results that the effective components of the contrastive loss may consist of the alignment and uniformity properties.
