Watching cartoons can be useful for children's intellectual, social and emotional development. However, the most popular video sharing platform today provides many videos with Elsagate content. Elsagate is a phenomenon that depicts childhood characters in disturbing circumstances (e.g., gore, toilet humor, drinking urine, stealing). Even with this threat easily available for children, there is no work in the literature addressing the problem. As the first to explore disturbing content in cartoons, we proceed from the most recent pornography detection literature applying deep convolutional neural networks combined with static and motion information of the video. Our solution is compatible with mobile platforms and achieved 92.6 of accuracy. Our goal is not only to introduce the first solution but also to bring up the discussion around Elsagate.
Alghowinem @cite_9 proposed a multimodal approach to detect inappropriate content in videos from YouTube Kids. For that, one-second slices are extracted for analysis and classification. Image frames, audio signal, transcribed text and their respective features (e.g., temporal robust features (TRoF), mel-frequency cepstral coefficient (MFCC), bag-of-words) are extracted from each slice. These features are then fed into individual classifiers, which are combined using a threshold-based decision strategy. According to Alghowinem, the paper acted as a proof of concept. But, the pilot experiment is performed on three videos which are not even cartoons.
@cite_9
2900026217 2752191396 2584992898 2022303741
Acknowledging the advantages as well as the dangers of the internet content on kids education and entertainment, YouTube Kids was created. Based on regulations for child-friendly programs, several violations are identified and restricted from viewable content. When a child surfs the Internet, the same regulations could be automatically detected and filtered. However, current YouTube Kids content filtering relies on meta-data attributes, where inappropriate content could pass the filtering mechanism. This research, propose an advanced real-time content filtering approach using automated video and audio analysis as an extra layer for kids safety. The proposed method utilizes the thin-slicing theory, where several one second slices are selected randomly from the clip and extracted. The use of a one-second slice will assure a temporal analysis of the clip content, and ensures a real-time content analysis. For each slice, audio is automatically transcribed using automatic speech recognition techniques to be further analysed for its linguistic content. Furthermore, the audio signal is analysed to detect event and scenes (e.g. explosion). The image frames extracted from the slices are also inspected for its content to avoid inappropriate scenes, such as violence. Upon the success of this approach on YouTube Kids application, investigation of its generalizability to other video applications, and other languages could be performed. The topic diversity of open-domain videos leads to various vocabularies and linguistic expressions in describing video contents, and therefore, makes the video captioning task even more challenging. In this paper, we propose an unified caption framework, M&M TGM, which mines multimodal topics in unsupervised fashion from data and guides the caption decoder with these topics. Compared to pre-defined topics, the mined multimodal topics are more semantically and visually coherent and can reflect the topic distribution of videos better. We formulate the topic-aware caption generation as a multi-task learning problem, in which we add a parallel task, topic prediction, in addition to the caption task. For the topic prediction task, we use the mined topics as the teacher to train a student topic prediction model, which learns to predict the latent topics from multimodal contents of videos. The topic prediction provides intermediate supervision to the learning process. As for the caption task, we propose a novel topic-aware decoder to generate more accurate and detailed video descriptions with the guidance from latent topics. The entire learning procedure is end-to-end and it optimizes both tasks simultaneously. The results from extensive experiments conducted on the MSR-VTT and Youtube2Text datasets demonstrate the effectiveness of our proposed model. M&M TGM not only outperforms prior state-of-the-art methods on multiple evaluation metrics and on both benchmark datasets, but also achieves better generalization ability. Current methods for video description are based on encoder-decoder sentence generation using recurrent neural networks (RNNs). Recent work has demonstrated the advantages of integrating temporal attention mechanisms into these models, in which the decoder network predicts each word in the description by selectively giving more weight to encoded features from specific time frames. Such methods typically use two different types of features: image features (from an object classification model), and motion features (from an action recognition model), combined by naive concatenation in the model input. Because different feature modalities may carry task-relevant information at different times, fusing them by naive concatenation may limit the model's ability to dynamically determine the relevance of each type of feature to different parts of the description. In this paper, we incorporate audio features in addition to the image and motion features. To fuse these three modalities, we introduce a multimodal attention model that can selectively utilize features from different modalities for each word in the output description. Combining our new multimodal attention model with standard temporal attention outperforms state-of-the-art methods on two standard datasets: YouTube2Text and MSR-VTT. This paper presents an efficient approach for copies detection in a large videos archive consisting of several hundred of hours. The video content indexing method consists of extracting the dynamic behavior on the local description of interest points and further on the estimation of their trajectories along the video sequence. Analyzing the low-level description obtained allows to highlight trends of behaviors and then to assign a label of behavior to each local descriptor. Such an indexing approach has several interesting properties: it provides a rich, compact and generic description, while labels of behavior provide a high-level description of the video content. Here, we focus on video Content Based Copy Detection (CBCD). Copy detection is problematic as similarity search problem but with prominent differences. To be efficient, it requires a dedicated on-line retrieval method based on a specific voting function. This voting function must be robust to signal transformations and discriminating versus high similarities which are not copies. The method we propose in this paper is a dedicated on-line retrieval method based on a combination of the different dynamic contexts computed during the off-line indexing. A spatio-temporal registration based on the relevant combination of detected labels is then applied. This approach is evaluated using a huge video database of 300 hours with different video tests. The method is compared to a state-of-the art technique in the same conditions. We illustrate that taking labels into account in the specific voting process reduces false alarms significantly and drastically improves the precision.