This has been demonstrated to some extent in previous work that has used specifically engineered alignment-based models (Lewis and Xia, 2008; Östling, 2015;<cite> Coke et al., 2016)</cite> , and we examine whether these results apply to neural network feature extractors and expand beyond word order and syntax to other types of typology as well.