Language Models with GloVe Word Embeddings
V Makarenkov, B Shapira, L Rokach - arXiv preprint arXiv:1610.03759, 2016
... Despite the huge size of the Common Crawl corpus, some words may not exist with the embeddings, so we set these words to random vectors, and use the same embeddings consistently if we encounter the same unseen word again in the text. ...