We extend <cite>our</cite> previous work on constituency parsing <cite>(Kitaev and Klein, 2018)</cite> by incorporating pre-training for ten additional languages, and compare the benefits of no pre-training, ELMo , and BERT (Devlin et al., 2018).