If we compare the widely used Conditional Random Fields (CRF) with newly proposed "deep architecture" sequence models<cite> (Collobert et al., 2011)</cite> , there are two things changing: from linear architecture to non-linear, and from discrete feature representation to distributional.