We re-implemented the string-to-dependency decoder described in<cite> (Shen et al., 2008</cite> (Pauls and Klein, 2011) , was employed to train (1) a five-gram LM on the Xinhua portion of LDC English Gigaword corpus v3 (LDC2007T07) and (2) a tri-gram dependency LM on the English dependency structures of the training data.