Pre-trained models play a vital role as feature extractors in various domains, e.g., BERT[1]} in the natural language processing domain and ImageNet pre-trained models[2]}[3]}[4]} in the image domain.
In the audio domain, pre-trained models (e.g., VGGish[5]}) have enabled recent advances in applications such as heart sound classification[6]}, Alzheimer's disease detection[7]}, conservation monitoring[8]}, audio captioning[9]}, audio retrieval[10]}, and so forth.
<FIGURE>