qfrodicio commited on
Commit
fa74e2c
1 Parent(s): b81ef74

Training complete

Browse files
README.md ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: MMG/mlm-spanish-roberta-base
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - precision
7
+ - recall
8
+ - f1
9
+ - accuracy
10
+ model-index:
11
+ - name: roberta-finetuned-intention-prediction-es
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # roberta-finetuned-intention-prediction-es
19
+
20
+ This model is a fine-tuned version of [MMG/mlm-spanish-roberta-base](https://huggingface.co/MMG/mlm-spanish-roberta-base) on an unknown dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 1.8935
23
+ - Precision: 0.6851
24
+ - Recall: 0.6851
25
+ - F1: 0.6851
26
+ - Accuracy: 0.6745
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 2e-05
46
+ - train_batch_size: 16
47
+ - eval_batch_size: 16
48
+ - seed: 42
49
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
+ - lr_scheduler_type: linear
51
+ - num_epochs: 20
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
56
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
57
+ | 2.3195 | 1.0 | 102 | 1.7653 | 0.4977 | 0.4977 | 0.4977 | 0.4881 |
58
+ | 1.3397 | 2.0 | 204 | 1.3826 | 0.6064 | 0.6064 | 0.6064 | 0.5933 |
59
+ | 0.884 | 3.0 | 306 | 1.2726 | 0.6495 | 0.6495 | 0.6495 | 0.6372 |
60
+ | 0.5805 | 4.0 | 408 | 1.3527 | 0.6571 | 0.6571 | 0.6571 | 0.6444 |
61
+ | 0.3923 | 5.0 | 510 | 1.3805 | 0.6732 | 0.6732 | 0.6732 | 0.6600 |
62
+ | 0.2565 | 6.0 | 612 | 1.4492 | 0.6801 | 0.6801 | 0.6801 | 0.6687 |
63
+ | 0.1782 | 7.0 | 714 | 1.4983 | 0.6766 | 0.6766 | 0.6766 | 0.6643 |
64
+ | 0.1196 | 8.0 | 816 | 1.5517 | 0.6840 | 0.6840 | 0.6840 | 0.6726 |
65
+ | 0.0922 | 9.0 | 918 | 1.5745 | 0.6777 | 0.6777 | 0.6777 | 0.6658 |
66
+ | 0.0577 | 10.0 | 1020 | 1.6238 | 0.6866 | 0.6866 | 0.6866 | 0.6748 |
67
+ | 0.042 | 11.0 | 1122 | 1.7542 | 0.6697 | 0.6697 | 0.6697 | 0.6578 |
68
+ | 0.0298 | 12.0 | 1224 | 1.7861 | 0.6842 | 0.6842 | 0.6842 | 0.6730 |
69
+ | 0.0201 | 13.0 | 1326 | 1.8079 | 0.6906 | 0.6906 | 0.6906 | 0.6812 |
70
+ | 0.0147 | 14.0 | 1428 | 1.8380 | 0.6833 | 0.6833 | 0.6833 | 0.6732 |
71
+ | 0.0109 | 15.0 | 1530 | 1.8730 | 0.6808 | 0.6808 | 0.6808 | 0.6708 |
72
+ | 0.0079 | 16.0 | 1632 | 1.8702 | 0.6864 | 0.6864 | 0.6864 | 0.6763 |
73
+ | 0.0067 | 17.0 | 1734 | 1.8907 | 0.6873 | 0.6873 | 0.6873 | 0.6766 |
74
+ | 0.0061 | 18.0 | 1836 | 1.8998 | 0.6826 | 0.6826 | 0.6826 | 0.6719 |
75
+ | 0.0057 | 19.0 | 1938 | 1.8974 | 0.6850 | 0.6850 | 0.6850 | 0.6741 |
76
+ | 0.0051 | 20.0 | 2040 | 1.8935 | 0.6851 | 0.6851 | 0.6851 | 0.6745 |
77
+
78
+
79
+ ### Framework versions
80
+
81
+ - Transformers 4.35.2
82
+ - Pytorch 2.1.0+cu121
83
+ - Datasets 2.16.1
84
+ - Tokenizers 0.15.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:07f571279b40a93712fe84ada015e28d96dee2e9f45ba48dfa352a87b8425d74
3
  size 501743200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb257573720a144ea6cca558d61f456632afbcbf31197558c54fe34213ce449d
3
  size 501743200
runs/Jan10_21-41-54_c6c8211e2688/events.out.tfevents.1704922938.c6c8211e2688.512.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d9256eaa71599c8b3d72a24458f0e7deed317f3314df1ea606e14e0d79f91a14
3
- size 20195
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b868f8279ccbdd1fbeba865f9108704506d828c8f22b60102d91841d58b5dd25
3
+ size 20549