We list six inconsistent configurations in literature, which lead to difficulties for fair comparison. • Dataset. Most work reports sequence labeling results on both CoNLL 2003 English NER (Tjong Kim Sang and De Meulder, 2003) and PTB POS (Marcus et al., 1993) datasets (Collobert et al., 2011; <cite>Ma and Hovy, 2016</cite>) . Ling et al. (2015) give results only on POS dataset, while some papers (Chiu and Nichols, 2016; Lample et al., 2016; Strubell et al., 2017) report results on the NER dataset only.