Different from the commonly used approaches that every single model has exactly one question and passage encoder (Seo et al., 2017;<cite> Hu et al., 2017)</cite> , our encoder layers simultaneously calculate multiple question and passage representations, for the purpose of serving different parts of attention functions of different phases.