Our basic bi-LSTM tagging model is a context bi-LSTM taking as input word embeddings w. We incorporate subtoken information using an hierarchical bi-LSTM architecture<cite> (Ling et al., 2015</cite>; Ballesteros et al., 2015 ).