As noted previously, for our embedding network we use a 3D CNN with a ResNet [1]} based architecture [2]}, specifically we use the ResNet-18 architecture. The output of the ResNet18 model is then downsampled using a linear layer to a size of 256.
To train the above embedding model, we use the Adam optimizer [3]} and set an initial learning rate of \(3e-4\)  and a batch size of 256.
Our overall loss function for the
