Recently, the other line has studied to pre-train a language model over large corpus to learn the inherent word-level knowledge in an unsupervised way<cite> [4,</cite> 8] , which achieves very promising performance.