In previous works<cite> (Zhou et al., 2017</cite>; Harrison and Walker, 2018) , named entity type features have been used. These features, however, only allow for the encoding of coarse level information such as knowledge of if an entity belongs to a set of predefined categories such as 'PERSON', 'LOCATION' and 'ORGANI-ZATION'.