When compared to<cite> Van Noord, Abzianidze, Toral, and Bos (2018)</cite> , retrained with the same data used in our systems, the largest improvement (3.6 and 3.5 for dev and test) comes from switching framework and changing certain parameters such as the optimizer and learning rate.