Next, we describe applications where partial invariance could prove to be useful. In online forums, identity-related discussions in which hatred or humiliation is expressed towards certain out-groups may be considered toxic, but similar discussions in a completely in-group discussion may not [1]}. Also, in forums that usually welcome diversity, explicitly mentioning identities would be acceptable and not toxic, unlike in forums that routinely make discriminatory remarks against minorities.
Existing systems to detect toxicity in online forums [2]}, [3]} do not, however, consider the environmental differences between forums and tend to perform poorly in more diverse settings [4]}. As such, a model that can distinguish the type/purpose of a forum and then infer toxic mentions from this additional context, can be expected improve performance.
