A smaller window size for the word embedding features might be better able to capture similar information to <cite>CFORM</cite>, which could explain the good performance of the model using a window size of 1.