Emotional content is a crucial ingredient in user-generated videos. However, the sparsely expressed emotions in the user-generated video cause difficulties to emotions analysis in videos. In this paper, we propose a new neural approach---Bi-stream Emotion Attribution-Classification Network (BEAC-Net) to solve three related emotion analysis tasks: emotion recognition, emotion attribution and emotion-oriented summarization, in an integrated framework. BEAC-Net has two major constituents, an attribution network and a classification network. The attribution network extracts the main emotional segment that classification should focus on in order to mitigate the sparsity problem. The classification network utilizes both the extracted segment and the original video in a bi-stream architecture. We contribute a new dataset for the emotion attribution task with human-annotated ground-truth labels for emotion segments. Experiments on two video datasets demonstrate superior performance of the proposed framework and the complementary nature of the dual classification streams.
Extensive research has been performed on the problem of recognizing emotions from visual information. Most work follow psychological theories that lay out a fixed number of emotion categories, such as Ekman's six pan-cultural basic emotions @cite_60 @cite_2 and Plutchik's wheel of emotion @cite_62 . These emotions are considered to be basic'' because they are associated with prototypical and widely recognized facial expressions, verbal and non-verbal language, and have distinct appraisal, antecedent events, and physiological responses. The emotions constantly affect our expression and perception via appraisal-behavior cycles throughout our daily activities, including video production and consumption.
@cite_62 @cite_2 @cite_60
2321825897 2126181565 2046677541
How do emotions and moods color cognition? In this article, we examine how such reactions influence both judgments and cognitive performance. We argue that many affective influences are due, not to affective reactions themselves, but to the information they carry about value. The specific kind of influence that occurs depends on the focus of the agent at the time. When making evaluative judgments, for example, an agent's positive affect may emerge as a positive attitude toward a person or object. But when an agent focuses on a cognitive task, positive affect may act like feedback about the value of one's approach. As a result, positive affect tends to promote cognitive, relational processes, whereas negative affect tends to inhibit relational processing, resulting in more perceptual, stimulus-specific processing. As a consequence, many textbook phenomena from cognitive psychology occur readily in happy moods, but are inhibited or even absent in sad moods (149). Wrist joint prosthesis. As a replacement for the joint in a human wrist, there is provided a prosthesis permitting both vertical motion, sidewise motion and rotary motion but preventing twisting motion around an axis projecting from and parallel with the lower forearm. For this purpose, there is provided a met al socket fitted with a prong receivable into a bone of the forearm. A plastic cup made of material self-lubricating with respect to such met al socket is fitted within said socket, snappable thereinto to resist but not prevent withdrawal therefrom and having a rectangular projection-and-slot relationship with said met al socket to permit relative motion with respect thereto in only a single plane. A met al ball is receivable into the recess of said plastic cup, snappable therewith to resist but not prevent withdrawal therefrom and has a rectangular projection-and-slot relationship with the inside of said plastic cup to permit relative movement with respect thereto in only a single plane, said plane being substantially perpendicular to said first-named plane. Suitable projections are provided on said ball for reception into the bones of selected fingers, normally the index and middle finger. Placement of said prosthesis in one position or a mirror image thereof will render said prosthesis without other change adaptable for use with one hand or the other hand as desired.