Text Classification
Transformers
PyTorch
Safetensors
English
bert
Inference Endpoints
Edit model card

Model Card for Model ID

This modelcard aims to be a base template for new models. It has been generated using this raw template.

Model Details

Model Description

  • Developed by: CHERGUELAINE Ayoub & BOUBEKRI Faycal
  • Shared by [optional]: HuggingFace
  • Model type: Language model
  • Language(s) (NLP): en
  • License: [More Information Needed]
  • Finetuned from model [optional]: ESG-Bert

Model Sources [optional]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details

Training Data

(AyoubChLin/20NewsGroup-AgNews-CnnNews)[https://huggingface.co/datasets/AyoubChLin/20NewsGroup-AgNews-CnnNews]

Fine-tuning hyper-parameters
  • learning_rate = 4e-5
  • batch_size = 8
  • max_seq_length = 256
  • num_train_epochs = 2.0

Testing Data

CNN-NEWS-Article

ag_news

Metrics

Accuracy

Results


CNN-NEWS-Article

ag_news

Summary

Downloads last month
14
Safetensors
Model size
109M params
Tensor type
I64
·
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Datasets used to train AyoubChLin/news-ESG-Bert