(4)<cite> Filippova et al. (2015)</cite> combined the predicted y i−1 with w i to help predict y i . This adds some dependency between consecutive labels. We do not do this because later we will introduce an ILP layer to introduce dependencies among labels.