2 Slot-filling data To extract the contexts for each triple in our dataset we use the distant supervision method described by <cite>Levy et al. (2017)</cite> . For each Wikidata document belonging to a given entity 1 we take all the denormalized tuples (property, entity 2 ) and extract the first sentence in the text containing both entity 1 and entity 2 . Negatives (contexts without answers) are constructed by finding pairs of triples with common entity 2 type (to ensure they contain good distractors), swapping their context if entity 2 is not present in the context of the other triple.