Data set: We use the KBP (Ji et al., 2011) dataset 9 prepared and publicly released by<cite> Surdeanu et al. (2012)</cite> for our experiment since it is 1) large and realistic, 2) publicly available, 3) most importantly, it is the only dataset that has associated human-labeled ground truth.