For making the input data itself as the supervision, image self-supervised learning Bootstrap Your Own Latent (BYOL)[1]} is suitable. BYOL learns representations of input invariant to augmentations by comparing augmented pair of the input unlike contrastive learning methods[2]}[3]} that compares among the batch inputs.
Therefore, we extended BYOL for audio application.
