Therefore, we incorporate attention mechanisms for CNN pooling, similar to [1]} yu2018qanet. Essentially, an attention mechanism computes a weighted sum of a set of candidate features (extracted by CNN), where the weights are computed by a controlling vector (for example, a max pooling vector for another CNN module).
