Past shared tasks on emotions use data with both overt expressions of emotions (I am so happy to see you!) as well as subtle expressions where the emotions have to be inferred, for instance from event descriptions. Further, most datasets do not focus on the cause or the stimulus of the emotion. Here, for the first time, we propose a shared task where systems have to predict the emotions in a large automatically labeled dataset of tweets without access to words denoting emotions. Based on this intention, we call this the Implicit Emotion Shared Task (IEST) because the systems have to infer the emotion mostly from the context. Every tweet has an occurrence of an explicit emotion word that is masked. The tweets are collected in a manner such that they are likely to include a description of the cause of the emotion - the stimulus. Altogether, 30 teams submitted results which range from macro F1 scores of 21 to 71 . The baseline (MaxEnt bag of words and bigrams) obtains an F1 score of 60 which was available to the participants during the development phase. A study with human annotators suggests that automatic methods outperform human predictions, possibly by honing into subtle textual clues not used by humans. Corpora, resources, and results are available at the shared task website at this http URL
With the aim to extend the coverage of ISEAR, build EmotiNet, a knowledge base to store situations and the affective reactions they have the potential to trigger. They show how the knowledge stored can be expanded using lexical and semantic similarity, as well as through the use of Web-extracted knowledge @cite_0 . The patterns used to populate the database are of the type I feel [emotion] when [situation]'', which was also a starting point for our task.
@cite_0
39229845
In the past years, there has been a growing interest in developing computational methods for affect detection from text. Although much research has been done in the field, this task still remains far from being solved, as the presence of affect is only in a very small number of cases marked by the presence of emotion-related words. In the rest of the cases, no such lexical clues of emotion are present in text and special commonsense knowledge is necessary in order to interpret the meaning of the situation described and understand its affective connotations. In the light of the challenges posed by the detection of emotions from contexts in which no lexical clue is present, we proposed and implemented a knowledge base – EmotiNet – that stores situations in which specific emotions are felt, represented as “action chains”. Following the initial evaluations, in this chapter, we describe and evaluate two different methods to extend the knowledge contained in EmotiNet: using lexical and ontological knowledge. Results show that such types of knowledge sources are complementary and can help to improve both the precision, as well as the recall of implicit emotion detection systems based on commonsense knowledge.