Unlike prior approaches <cite>(Lee and Dernoncourt, 2016</cite>; Ortega and Vu, 2017 ) that rely on pre-trained word embeddings, we learn the projection weights on the fly during training, i.e word embeddings (or vocabularies) do not need to be stored.