Video instance shadow detection can generate shadow-object association masks for paired instances across frames, which can be used not only to remove objects together with their associated shadows but also to replace the video background and retain the objects with their shadows.
Fig. REF  (a)
shows some snapshots of this video inpainting application using the extracted shadow-object association masks provided by SSIS-Track. With the help of SSIS-Track, the SOTA video inpainting method [1]} can successfully remove two motorcycles with their associated shadows simultaneously.
Also, Fig. REF  (b)
shows that our shadow-object association masks can cooperate with Stable Diffusion [2]} to replace the video background and put the dancer on Mars with her associated shadow.
<FIGURE>