The encoder of MSTR takes multi-scale input feature maps given by a backbone CNN, performs a series of deformable attention modules in Eq.(REF ), and finally generates encoded feature maps.
Positional encoding [1]} is added to preserve spatial information while level embedding [2]} is added to denote which resolution did the image feature comes from.
