For this experiment, we use the HatefulMemes Challenge Dataset [1]}.
This is a multi-modal dataset consisting of \(10,000\)  images with associated text annotated with types of hate speech.
The hate speech categories are: inciting violence, dehumanizing, inferiority, contempt, mocking, slurs, exclusion and no hate-speech.
Those are further split into different protected categories (race, religion, gender, disability, nationality and `pc_empty` for no protected category).
The train split contains \(8,500\)  memes and the dev set contains 500 memes.
The distribution of different protected categories and types of hate-speech is shown in Appendix Figure REF .
<TABLE>