Based on the transformer model<cite> (Vaswani et al., 2017)</cite> , we design a novel co-attention mechanism. Our proposed mechanism consists of two symmetrical branches that work in parallel to assimilate information from two input channels respectively.