Other approaches uses specialized embeddings for transfer learning. [1]} applied transfer learning to a pretrained GPT2 model, which was pretrained in the text modality. This approach also requires several other prerequisites, such as a BERTScore [2]} model, and several preprocessing steps for caption retrieval. In another vein, [3]} used a combination of pretrained audio embeddings and subject-verb embeddings to generate captions.
