The training data consists of about 28 million English words and 23.3 million 5 Note that our results on WSJ are not exactly the same as those reported in <cite>(McDonald et al., 2005b</cite> ), since we used slightly different head finding rules.