diogopaes10's picture
update model card README.md
0dfc416
|
raw
history blame
6.53 kB
metadata
license: mit
base_model: microsoft/deberta-v3-base
tags:
  - generated_from_trainer
metrics:
  - f1
  - accuracy
  - precision
  - recall
model-index:
  - name: 011-microsoft-deberta-v3-base-finetuned-yahoo-8000_2000
    results: []

011-microsoft-deberta-v3-base-finetuned-yahoo-8000_2000

This model is a fine-tuned version of microsoft/deberta-v3-base on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 1.8660
  • F1: 0.7055
  • Accuracy: 0.7045
  • Precision: 0.7076
  • Recall: 0.7045
  • System Ram Used: 4.2773
  • System Ram Total: 83.4807
  • Gpu Ram Allocated: 2.0897
  • Gpu Ram Cached: 25.8555
  • Gpu Ram Total: 39.5640
  • Gpu Utilization: 48
  • Disk Space Used: 35.8287
  • Disk Space Total: 78.1898

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 15

Training results

Training Loss Epoch Step Validation Loss F1 Accuracy Precision Recall System Ram Used System Ram Total Gpu Ram Allocated Gpu Ram Cached Gpu Ram Total Gpu Utilization Disk Space Used Disk Space Total
1.6916 0.75 188 1.1063 0.6708 0.6755 0.6900 0.6755 4.0191 83.4807 2.0898 25.8555 39.5640 50 24.8064 78.1898
0.9694 1.5 376 0.9586 0.7181 0.7195 0.7198 0.7195 4.2536 83.4807 2.0898 25.8555 39.5640 50 29.6418 78.1898
0.8509 2.26 564 0.9748 0.7070 0.712 0.7161 0.712 4.1602 83.4807 2.0898 25.8555 39.5640 46 29.6418 78.1898
0.7475 3.01 752 0.9447 0.7122 0.714 0.7148 0.714 4.1607 83.4807 2.0898 25.8555 39.5640 50 29.6420 78.1898
0.5841 3.76 940 1.0064 0.7077 0.711 0.7225 0.711 4.1889 83.4807 2.0898 25.8555 39.5640 47 29.6420 78.1898
0.4972 4.51 1128 1.0585 0.7110 0.714 0.7129 0.714 4.1766 83.4807 2.0898 25.8555 39.5640 47 29.6421 78.1898
0.4555 5.26 1316 1.1175 0.7086 0.7075 0.7151 0.7075 4.2257 83.4807 2.0898 25.8555 39.5640 46 33.7652 78.1898
0.3535 6.02 1504 1.1749 0.7032 0.708 0.7077 0.708 4.2302 83.4807 2.0898 25.8555 39.5640 50 33.7653 78.1898
0.2614 6.77 1692 1.2028 0.7056 0.709 0.7079 0.709 4.2376 83.4807 2.0898 25.8555 39.5640 49 33.7654 78.1898
0.2321 7.52 1880 1.2961 0.7019 0.698 0.7085 0.698 4.2248 83.4807 2.0898 25.8555 39.5640 49 33.7656 78.1898
0.197 8.27 2068 1.3960 0.7098 0.712 0.7137 0.712 4.2194 83.4807 2.0898 25.8555 39.5640 45 33.7657 78.1898
0.1505 9.02 2256 1.4310 0.7093 0.7075 0.7133 0.7075 4.2418 83.4807 2.0898 25.8555 39.5640 48 35.8277 78.1898
0.1132 9.78 2444 1.5454 0.7053 0.7045 0.7097 0.7045 4.2931 83.4807 2.0898 25.8555 39.5640 48 35.8278 78.1898
0.0979 10.53 2632 1.6420 0.7090 0.708 0.7171 0.708 4.2793 83.4807 2.0898 25.8555 39.5640 45 35.8281 78.1898
0.0818 11.28 2820 1.6869 0.7062 0.7065 0.7102 0.7065 4.2822 83.4807 2.0898 25.8555 39.5640 49 35.8281 78.1898
0.062 12.03 3008 1.7818 0.7043 0.701 0.7123 0.701 4.2864 83.4807 2.0901 25.8555 39.5640 50 35.8282 78.1898
0.0433 12.78 3196 1.7981 0.7080 0.707 0.7110 0.707 4.2666 83.4807 2.0898 25.8555 39.5640 49 35.8282 78.1898
0.0368 13.54 3384 1.8403 0.7079 0.7055 0.7131 0.7055 4.2783 83.4807 2.0898 25.8555 39.5640 47 35.8285 78.1898
0.0379 14.29 3572 1.8536 0.7052 0.705 0.7074 0.705 4.3013 83.4807 2.0898 25.8555 39.5640 47 35.8286 78.1898

Framework versions

  • Transformers 4.31.0
  • Pytorch 2.0.1+cu118
  • Datasets 2.13.1
  • Tokenizers 0.13.3