Similar to SimCLR, MoCo [1]}, [2]} is a SSL method that uses InfoNCE loss. The difference is that while SimCLR uses a large mini-batch size to store negative examples, MoCo stored negative examples using a memory bank, which is the representation computed via a momentum updated version (or moving average version) of the network.
