We used a total of seven image, video, and audio encoders. For image encoders, we use CLIP [1]}, ResNet-50 (RN50) [2]}, and EfficientNet-B7 (EN7) [3]}. For RN50 and EN7 we use the PyTorch [4]} implementation pretrained on ImageNet [5]}. We pass the center frame through the network and extract the penultimate layer embeddings.
