We employ cld3 package to detect the language of each token in the embeddings of each layer, which is a language detection library based on the Compact Language Detector \(3\) model developed by Google. Furthermore, if the detection result is reliable, i.e., cld3.get_language(token).is_reliable\(==True\), we adopt the detection results, otherwise the token is categorized as a non-word.