In this section, we start with a basic pipeline of a transformer-based end-to-end HOI detector [1]}.
Then, we explain the deformable attention module [2]} that reduces computational cost in attention, thus enabling the transformer to take multi-scale feature maps as an input.
Afterward, we discuss why the direct application of multi-scale deformable attentions is not suitable for HOI detection.
