Performance depends on encoder capacity. We compare two different encoder architectures for our audio task, trained and evaluated identically: (i) a lower capacity encoder, Kymatio [1]}, InD testset accuracy: 0.75 and (ii) the higher capacity M5 encoder (Section ), InD test set accuracy: 0.85.
We observe that TRUST-LAPSE performs worse with Kymatio. It is not able to flag OOD examples (GSC-Words) based on TRUST-LAPSE scores (Fig. REF , top). On the other hand, TRUST-LAPSE performs really well with the M5 encoder (Table REF ) and is able to correctly separate out semantic InD samples from semantic OOD samples (Appendix Fig. REF , right). Thus, the success of TRUST-LAPSE is highly dependent on the capacity of the trained encoder.
