Learning from multiple languages have been shown to be of benefit both in unsupervised learning of syntax and part-of-speech (Snyder et al., 2009; BergKirkpatrick and Klein, 2010) and in transfer learning of dependency syntax (Cohen et al., 2011; 256 cross-lingual word clusters and the same feature templates as<cite> Täckström et al. (2012)</cite> , with the exception that the transition factors are not conditioned on the input.