AT-CNN [1]}, the current best performing model on Clotho, follows a similar approach with a 2 pipeline which first pretrains the CNN10 [2]} / CRNN5 [3]} encoder on an audio tagging task, and then performs transfer learning on the pretrained model on the audio tagging task. Similarly, the Audio Captioning Transformer [4]} also pretrains the encoder on audio tagging before training on audio tagging.
