Image retrieval.
The instance retrieval (IR) model [1]}, [2]}, [3]} encodes the information of the visual similarity between objects to the feature. The IR representation powerful in that it enables the search engine to find the visually identical items among the million-scale images. Inspired by this, we trained IR model using DeepFashion [4]} dataset and extracted the IR features off-the-shelf. Then we force the output of the image encoder and multimodal composers (e.g., TIRG or RTIC) to be the same with the extracted IR feature of a given candidate or target image. It is a knowledge transfer from the IR model to our image encoder and the multimodal composer instead of learning from scratch using pair-wise ranking loss.
