Overall, SOBA-VID has 292 videos with 7045 frames, collected from
(i) existing datasets, DAVIS [1]}, YouTube-VIS [2]}, and OVIS [3]}, (ii) self-collected videos, and (iii) keyword search on the Internet by “shadow plus common instances.”
We randomly split the videos into a training set (232 videos, 5863 frames) and a testing set (60 videos, 1182 frames).
For the videos in test set, we manually annotate the masks of each shadow/object instance frame by frame using Apple Pencil and associate them to form shadow-object pairs (134 pairs in total); see Fig. REF  for some examples.
Further, we analyze the statistics of SOBA-VID.
From Fig. REF , we can see that
(i) SOBA-VID contains a diverse number of paired shadow-object associations per video, with around 2.23 pairs on average; and
(ii) as shown in the right sub-figure, the length of both videos and instances are diverse
and the average lengths of videos and instances are \(19.7\)  and \(17.2\) , respectively.
Note that Fig. REF  (d) shows various example frames in SOBA-VID; please refer to the supplementary material for more examples and results.
