Word Representation on Small Background Texts
L Li, Z Jiang, Y Liu, D Huang - Chinese National Conference on Social Media …, 2016
... For example, Pennington et al. (2014) used Wikipedia, Gigaword 5 and Common Crawl to learn word representations, each of which contained billions of tokens. There was not always a monotonic increase in performance as the amount of background texts increased. ...