Frame duplication is to duplicate a sequence of consecutive frames and insert or replace to conceal or imitate a specific event content in the same source video. To automatically detect the duplicated frames in a manipulated video, we propose a coarse-to-fine deep convolutional neural network framework to detect and localize the frame duplications. We first run an I3D network to obtain the most candidate duplicated frame sequences and selected frame sequences, and then run a Siamese network with ResNet network to identify each pair of a duplicated frame and the corresponding selected frame. We also propose a heuristic strategy to formulate the video-level score. We then apply our inconsistency detector fine-tuned on the I3D network to distinguish duplicated frames from selected frames. With the experimental evaluation conducted on two video datasets, we strongly demonstrate that our proposed method outperforms the current state-of-the-art methods.
Recently, Huang @cite_12 proposed a fusion of audio forensics detection methods for video inter-frame forgery. Zhao @cite_23 developed a similarity analysis based method to detect inter-frame forgery in a video shot. In this method, the HSV color histogram is calculated to detect and locate tampered frames in the shot, and then the SURF feature extraction and FLANN (Fast Library for Approximate Nearest Neighbors) matching are used for further confirmation.
@cite_23 @cite_12
2798793675 2800664266
Despite recent emergence of video caption methods, how to generate fine-grained video descriptions (i.e., long and detailed commentary about individual movements of multiple subjects as well as their frequent interactions) is far from being solved, which however has great applications such as automatic sports narrative. To this end, this work makes the following contributions. First, to facilitate this novel research of fine-grained video caption, we collected a novel dataset called Fine-grained Sports Narrative dataset (FSN) that contains 2K sports videos with ground-truth narratives from YouTube.com. Second, we develop a novel performance evaluation metric named Fine-grained Captioning Evaluation (FCE) to cope with this novel task. Considered as an extension of the widely used METEOR, it measures not only the linguistic performance but also whether the action details and their temporal orders are correctly described. Third, we propose a new framework for fine-grained sports narrative task. This network features three branches: 1) a spatio-temporal entity localization and role discovering sub-network; 2) a fine-grained action modeling sub-network for local skeleton motion description; and 3) a group relationship modeling sub-network to model interactions between players. We further fuse the features and decode them into long narratives by a hierarchically recurrent structure. Extensive experiments on the FSN dataset demonstrates the validity of the proposed framework for fine-grained video caption. Abstract The forgery operation of digital video in the temporal domain is often accompanied by the synchronization of the audio channel operation. In this paper, we proposed a fusion of audio forensics detection methods for video inter-frame forgery. First, the audio channel of the video is extracted, and discrete wavelet packet decomposition and analysis of singularity points of audio signals are used to locate the forged singularity points. Next, features of each frame of the video are extracted with the perceptual hash and used to calculate the similarity between consecutive frames, to locate the forgery position in the video frame sequence. We fused the results of the audio channel and the video frame sequence channel. The QDCT feature is used to further fine detect the suspected forgery location. Our method can position replication source locations for copy-move forgery. Experiments show that our method has higher accuracy and better performance in comparison with similar methods, especially on the delete forgery operation.