With state-of-the-art empirical results, most regard BiLSTM-CNN as a robust core module for sequence-labeling NER [1,<cite> 2,</cite> 3, 4, 5] . However, each direction of BiLSTM only sees and encodes half of a sequence at each time step. This paper explores two types of cross-structures to help cope with the problem: Cross-BiLSTM-CNN and Att-BiLSTM-CNN.