For the Toxic Spans Detection dataset, we followed the same evaluation procedure of the SemEval Toxic Spans Detection competition. The organisers have used F1 score mentioned in [1]} to evaluate the systems. Let system \(A_i\)  return a set \(S^t_{A_i}\)  of character offsets, for parts of the post found to be toxic. Let \(G_t\)  be the character offsets of the ground truth annotations of t. We compute the F1 score of system \(A_i\)  with respect to the ground truth G for post t as mentioned in Equation REF , where \(\vert \)  ·\(\vert \)  denotes set cardinality.
\(F_{1}^{t}\left(A_{i}, G\right)=\frac{2 \cdot P^{t}\left(A_{i}, G\right) \cdot R^{t}\left(A_{i}, G\right)}{P^{t}\left(A_{i}, G\right)+R^{t}\left(A_{i}, G\right)}\) 
