Solutions to enhance the IORNN reranker of<cite> Le and Zuidema (2014)</cite> were proposed. We showed that, by replacing the original softmax function with a hierarchical softmax, the reranker's computational complexity significantly decreases.