We implement the Modality Transition Module on the existing models mentioned above in Sec. REF , and annotated with suffix MT: ShowTell_MT, Adaptive_MT, Att2in_MT, Att2all_MT, and TopDown_MT. The detailed training curves are illustrated in Fig. REF , and the steadily increasing red line on the top is the proposed MTM built on TopDown [1]} attention.
MTM also performs well on other encoder-decoder models, demonstrating strong ability to be embedded in the conventional image captioning models with good adaptability.
