SimCLR achieved linear evaluation accuracy that matches the performance of a supervised network, and transfer learning accuracy that outperforms the supervised baseline on several datasets. With several improvements including a bigger and deeper projector head, SimCLRv2 [1]} achieved even better performance that outperforms the semi-supervised learning baselines.
