In natural language processing (NLP), a lot of research focuses on numeric word representations. Static pretrained word embeddings like word2vec [1]} are recently replaced by dynamic, contextual embeddings, such as ELMo [2]} and BERT [3]}. These generate a word vector based on the context the word appears in, mostly using the sentence as the context.
