Following previous work (e.g. (Blitzer et al., 2006<cite> (Blitzer et al., , 2007</cite> Chen et al., 2012) our feature representation consists of binary indicators for the occurrence of word unigrams and bigrams in the represented document.