metadata
license: mit
base_model: microsoft/deberta-v3-base
tags:
- generated_from_trainer
metrics:
- f1
- accuracy
- precision
- recall
model-index:
- name: 011-microsoft-deberta-v3-base-finetuned-yahoo-8000_2000
results: []
011-microsoft-deberta-v3-base-finetuned-yahoo-8000_2000
This model is a fine-tuned version of microsoft/deberta-v3-base on the None dataset. It achieves the following results on the evaluation set:
- Loss: 1.8660
- F1: 0.7055
- Accuracy: 0.7045
- Precision: 0.7076
- Recall: 0.7045
- System Ram Used: 4.2773
- System Ram Total: 83.4807
- Gpu Ram Allocated: 2.0897
- Gpu Ram Cached: 25.8555
- Gpu Ram Total: 39.5640
- Gpu Utilization: 48
- Disk Space Used: 35.8287
- Disk Space Total: 78.1898
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 32
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 15
Training results
Training Loss | Epoch | Step | Validation Loss | F1 | Accuracy | Precision | Recall | System Ram Used | System Ram Total | Gpu Ram Allocated | Gpu Ram Cached | Gpu Ram Total | Gpu Utilization | Disk Space Used | Disk Space Total |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1.6916 | 0.75 | 188 | 1.1063 | 0.6708 | 0.6755 | 0.6900 | 0.6755 | 4.0191 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 50 | 24.8064 | 78.1898 |
0.9694 | 1.5 | 376 | 0.9586 | 0.7181 | 0.7195 | 0.7198 | 0.7195 | 4.2536 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 50 | 29.6418 | 78.1898 |
0.8509 | 2.26 | 564 | 0.9748 | 0.7070 | 0.712 | 0.7161 | 0.712 | 4.1602 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 46 | 29.6418 | 78.1898 |
0.7475 | 3.01 | 752 | 0.9447 | 0.7122 | 0.714 | 0.7148 | 0.714 | 4.1607 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 50 | 29.6420 | 78.1898 |
0.5841 | 3.76 | 940 | 1.0064 | 0.7077 | 0.711 | 0.7225 | 0.711 | 4.1889 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 47 | 29.6420 | 78.1898 |
0.4972 | 4.51 | 1128 | 1.0585 | 0.7110 | 0.714 | 0.7129 | 0.714 | 4.1766 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 47 | 29.6421 | 78.1898 |
0.4555 | 5.26 | 1316 | 1.1175 | 0.7086 | 0.7075 | 0.7151 | 0.7075 | 4.2257 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 46 | 33.7652 | 78.1898 |
0.3535 | 6.02 | 1504 | 1.1749 | 0.7032 | 0.708 | 0.7077 | 0.708 | 4.2302 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 50 | 33.7653 | 78.1898 |
0.2614 | 6.77 | 1692 | 1.2028 | 0.7056 | 0.709 | 0.7079 | 0.709 | 4.2376 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 49 | 33.7654 | 78.1898 |
0.2321 | 7.52 | 1880 | 1.2961 | 0.7019 | 0.698 | 0.7085 | 0.698 | 4.2248 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 49 | 33.7656 | 78.1898 |
0.197 | 8.27 | 2068 | 1.3960 | 0.7098 | 0.712 | 0.7137 | 0.712 | 4.2194 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 45 | 33.7657 | 78.1898 |
0.1505 | 9.02 | 2256 | 1.4310 | 0.7093 | 0.7075 | 0.7133 | 0.7075 | 4.2418 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 48 | 35.8277 | 78.1898 |
0.1132 | 9.78 | 2444 | 1.5454 | 0.7053 | 0.7045 | 0.7097 | 0.7045 | 4.2931 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 48 | 35.8278 | 78.1898 |
0.0979 | 10.53 | 2632 | 1.6420 | 0.7090 | 0.708 | 0.7171 | 0.708 | 4.2793 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 45 | 35.8281 | 78.1898 |
0.0818 | 11.28 | 2820 | 1.6869 | 0.7062 | 0.7065 | 0.7102 | 0.7065 | 4.2822 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 49 | 35.8281 | 78.1898 |
0.062 | 12.03 | 3008 | 1.7818 | 0.7043 | 0.701 | 0.7123 | 0.701 | 4.2864 | 83.4807 | 2.0901 | 25.8555 | 39.5640 | 50 | 35.8282 | 78.1898 |
0.0433 | 12.78 | 3196 | 1.7981 | 0.7080 | 0.707 | 0.7110 | 0.707 | 4.2666 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 49 | 35.8282 | 78.1898 |
0.0368 | 13.54 | 3384 | 1.8403 | 0.7079 | 0.7055 | 0.7131 | 0.7055 | 4.2783 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 47 | 35.8285 | 78.1898 |
0.0379 | 14.29 | 3572 | 1.8536 | 0.7052 | 0.705 | 0.7074 | 0.705 | 4.3013 | 83.4807 | 2.0898 | 25.8555 | 39.5640 | 47 | 35.8286 | 78.1898 |
Framework versions
- Transformers 4.31.0
- Pytorch 2.0.1+cu118
- Datasets 2.13.1
- Tokenizers 0.13.3