Our use of language embeddings as an initialization to fine-tune (specialize) from, as opposed to formulating a joint objective with language and audio context<cite> (Kiela and Clark, 2015)</cite> is driven by the fact that we are interested in embeddings for words grounded in sounds, and not better generic word similarity.