DETR has been recently proposed to eliminate the need for many hand-designed components in object detection [1]}.
Deformable DETR [2]} mitigates the slow convergence and high complexity issues of DETR and successfully exploits multi-resolution feature maps.
The deformable attention modules in [2]} attend to a small set of sampling locations as a pre-filter for prominent key elements out of all the feature map pixels.
However, unlike object detection, we observed that this pre-filter seriously deteriorates performance when applied to HOI detection.
Therefore, in this paper, we focus on finding a proper way to incorporate deformable attention into HOI detection for exploiting multi-scale feature maps.
