Videos. Defining discourse representation of videos comprises three main steps, namely: (a) identification of elementary discourse units (EDUs) [1]}; (b) identification of discourse acts, which are categories of EDUs that pertain to their role in the videos and (c) identification of discourse relations, which aid in understanding relationships among EDUs. In our pilot experiments, we found that shots are effective EDUs for videos. A shot in a video refers to a contiguous recording of one or more frames depicting a continuous action in space and time. Therefore, we first segment the video into shots and then define the discourse acts and relations among shots. We used the dense captioning events dataset to sample videos and classified shots in the videos using a manual iterative process with experts until a stable set of discourse acts and relations are obtained.
