Details of attention on image feature patches. In the attention guided regional proposal-based framework, we set the size of image feature patch as (5, 4) and use a 1 depth and 8-head multi self-attention layer [1]}. We connect the output of the ResNet [2]} directly into the attention module without any linear transformations and non-linear activation.
<FIGURE>