Contrastive Predictive Coding (CPC) [5] and wav2vec <cite>[7]</cite> use a multi-layer CNN to encode past context, representations are learned by predicting the future in latent space under a contrastive binary classification task.