Recently vision-and-language representation learning is becoming a more and more popular research topic.
This trend has also motivated people to study the commerce-specific pre-training [1]}, [2]}, [3]}, [4]}.
In those works, the authors pre-train the transformer-based [5]} model on commerce image-text pairs, then fine-tune it on image-text retrieval, image captioning, category recognition, etc.
However, most of existing works were trained on the medium-scale image-text pairs and evaluated on limited academic tasks.
This raises a question: can Facebook learn a more generalized multimodal representation for various practical commerce-related applications?
