Distilroberta for toxic comment detection

See my GitHub repo toxic-comment-server

The model was trained from DistilRoberta on Kaggle Toxic Comments with the BCEWithLogits loss for Multi-Label prediction. Thus, please use the sigmoid activation on the logits (not made to use the softmax output, e.g. like the HF widget).

Evaluation

F1 scores:

  toxic: 0.72
  severe_toxic: 0.38
  obscene: 0.72
  threat: 0.52
  insult: 0.69
  identity_hate: 0.60

  Macro-F1: 0.61

Downloads last month: 632

Inference Examples

Text Classification

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.