Table REF  shows the comparison between our method and the baselines. It also compares with the methods attended to this year's challenge. While our method overpass all the baselines on nDCG, it falls short on mAP. The MI-MM approach projects both modalities onto a shared action space using linear layers via max-margin loss, which is a simplified version of [1]}. The JPoSE approach [2]} uses a triplet loss to separate captions into the verb and noun spaces. The JPoSE* refers to our implementation. DCRL [3]} considers both inter-modal and intra-modal constraints at the same time to retain both cross-modal semantic similarity and modality-specific consistency in the embedding space.
