For example, <cite>Zhao et al. (2018a)</cite> and Rudinger et al. (2018) show that coreference resolution systems relying on word embeddings encode such occupational stereotypes. In contrast, we analyze bias in contextualized word representations and its effect on a downstream task.