We consider two baselines in our comparison: (i) adopt SSIS [1]} to detect shadow instances, object instances, and shadow-object associations on each individual frame and use the IoU Tracker [2]} to match the instances across different frames based on the IoU values between the detected bounding boxes; and
(ii) leverage the tracking algorithm Mask2former[3]} to detect and track the object instances across all video frames, use SSIS to detect the shadow/object instances and shadow-object associations on each frame, and merge the detection results with the tracking results based on the mask IoU of each object instance.
