We experiment with embeddings from three image encoders: CLIP [1]}, RN50 [2]}, and EN7 [3]}, three video encoders: R(2+1)D [4]}, Swin [5]}, and C4C [6]}, and one audio encoder: YN [7]}. For both character frame and motion matching, we use a 2-layer MLP with leaky ReLU [8]} activation and train with Adam [9]} optimizer. A set of hyperparameters are separately tuned for frame matching and motion matching datasets and are used across experiments of all encoders. More details for this experiment can be found in Supplementary REF .
<TABLE>