Discourse segmentation aims to segment Elementary Discourse Units (EDUs) and is a fundamental task in discourse analysis. For Chinese, previous researches identify EDUs just through discriminating the functions of punctuations. In this paper, we argue that Chinese EDUs may not end at the punctuation positions and should follow the definition of EDU in RST-DT. With this definition, we conduct Chinese discourse segmentation with the help of English labeled data.Using discourse commonality between English and Chinese, we design an adversarial neural network framework to extract common language-independent features and language-specific features which are useful for discourse segmentation, when there is no or only a small scale of Chinese labeled data available. Experiments on discourse segmentation demonstrate that our models can leverage common features from bilingual data, and learn efficient Chinese-specific features from a small amount of Chinese labeled data, outperforming the baseline models.
The main motivation of cross-lingual tasks is to use the language commonality between languages or remedy the lack of labeled data in a language. One kind of methods are to project annotations across parallel corpus @cite_11 @cite_14 @cite_42 @cite_33 . However, it is difficult to obtain parallel corpus. Then, one kind of the alternative methods are statistic model based and require cross-lingual features @cite_0 @cite_45 ; and the other kind of methods are neural network based, since word embeddings in different languages have the capability of representing semantic meanings in the same space. Besides bilingual word embeddings, bilingual character embeddings also improve the performance @cite_31 @cite_6 . However, these work are usually constrained to a language family such as Indo-European languages which share some same characters @cite_37 . For Chinese and English which belong to different language families, we propose a method to get Universal Chinese POS tags and use adversarial network to solve the language adaption problem inspired by @cite_10 , @cite_20 and @cite_17 .
@cite_37 @cite_14 @cite_33 @cite_42 @cite_17 @cite_6 @cite_0 @cite_45 @cite_31 @cite_10 @cite_20 @cite_11
2336505456 2762484717 2251804196 145107721
Despite interest in using cross-lingual knowledge to learn word embeddings for various tasks, a systematic comparison of the possible approaches is lacking in the literature. We perform an extensive evaluation of four popular approaches of inducing cross-lingual embeddings, each requiring a different form of supervision, on four typographically different language pairs. Our evaluation setup spans four different tasks, including intrinsic evaluation on mono-lingual and cross-lingual similarity, and extrinsic evaluation on downstream semantic and syntactic applications. We show that models which require expensive cross-lingual knowledge almost always perform better, but cheaply supervised models often prove competitive on certain tasks. State-of-the-art methods for learning cross-lingual word embeddings have relied on bilingual dictionaries or parallel corpora. Recent studies showed that the need for parallel data supervision can be alleviated with character-level information. While these methods showed encouraging results, they are not on par with their supervised counterparts and are limited to pairs of languages sharing a common alphabet. In this work, we show that we can build a bilingual dictionary between two languages without using any parallel corpora, by aligning monolingual word embedding spaces in an unsupervised way. Without using any character information, our model even outperforms existing supervised methods on cross-lingual tasks for some language pairs. Our experiments demonstrate that our method works very well also for distant language pairs, like English-Russian or English-Chinese. We finally describe experiments on the English-Esperanto low-resource language pair, on which there only exists a limited amount of parallel data, to show the potential impact of our method in fully unsupervised machine translation. Our code, embeddings and dictionaries are publicly available. We present a novel, count-based approach to obtaining inter-lingual word representations based on inverted indexing of Wikipedia. We present experiments applying these representations to 17 datasets in document classification, POS tagging, dependency parsing, and word alignment. Our approach has the advantage that it is simple, computationally efficient and almost parameter-free, and, more importantly, it enables multi-source crosslingual learning. In 14 17 cases, we improve over using state-of-the-art bilingual embeddings. The information available in languages other than English on the World Wide Web is increasing significantly. To cross language boundaries between different languages, dictionaries are the most typical tools. However, the general-purpose dictionary is less sensitive in genre and domain and it is impractical to manually construct tailored bilingual dictionaries or sophisticated multilingual thesauri for large applications. Corpus-based approaches, which do not have the limitation of dictionaries, provide a statistical translation model to cross the language boundary. The objective of this research work is to mine English Chinese parallel documents automatically from the World Wide Web. In this paper, we present an alignment method based on dynamic programming to identify the one-to-one Chinese and English title pairs. The longest common subsequence (LCS) is applied to find the most reliable Chinese translation of an English word. A score function is then proposed to determine the optimal title pairs. Experiments have been conducted to investigate the performance of the proposed method. The precision of the result is 0.995 while the recall is 0.8096.