Despite them being dominant in the research literature, reproducing published results for neural models can be challenging, even if the codes are available open source. For example, Reimers and Gurevych (2017b) conduct a large number of experiments using the code of <cite>Ma and Hovy (2016)</cite> , but cannot obtain comparable results as reported in the paper.