We discover that ELMo's performance improvements over the baseline are robust across varying levels of ambiguity, whereas the advantage of <cite>Hu et al. (2016)</cite> is reversed in sentences of low ambiguity (restricting to A-but-B style sentences).