We also experiment with the option to either use the pretrained GloVe word embeddings or randomly initialized word embeddings (then updated during training).
We experiment with the option using randomly initialized word embeddings (then updated during training).