In reconstruction-based approaches have no negative samples; the model directly attempts to reconstruct the input.
Autoencoder-style approaches are typical reconstruction-based approaches [1]}, [2]}, [3]}.
A variant of wav2vec 2.0, DeCoAR 2.0 [4]} replaces the contrastive loss with a reconstruction loss.
The recent HuBERT [5]} approach can also be considered a reconstruction-based approach.
We discuss the HuBERT approach in more detail in the next section.
