Embedding Model
We adopt DeeplabV2 [1]} built on the ResNet-101 [2]} backbone structure as our feature extractor \(\phi \) . This choice allows a direct comparison of our method with the baseline, PML [3]}.
First, we use the pretrained model on COCO [4]} dataset as the initialization for semantic segmentation. Then the ASPP [1]} layer for classification is removed and replaced by our video-specific mapping \(W\) .
