Audio. We use raw audio from Google Speech Commands (GSC) dataset (labels: 0-9 + words) [1]} and Free Spoken Digits Dataset (FSDD) (labels: 0-9) [2]}. We train an M5 encoder [3]} with raw audio data from GSC 0-9 and evaluate it on (a) unseen samples from GSC 0-9 (full semantic overlap), (b) FSDD 0-9 (full semantic overlap), and (c) samples from the non-digit words from GSC (no semantic overlap).
