Previous work (Gormley et al., 2015;<cite> Nguyen and Grishman, 2016</cite>; Fu et al., 2017) set, and the other half of bc, cts and wl as the test sets. We followed their split of documents and their split of the relation types for asymmetric relations.