phunguyen01 commited on
Commit
e224194
1 Parent(s): c77208c

Model save

Browse files
Files changed (2) hide show
  1. README.md +75 -0
  2. model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: mit
4
+ base_model: microsoft/deberta-v3-small
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - accuracy
9
+ - f1
10
+ model-index:
11
+ - name: testhehehe
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # testhehehe
19
+
20
+ This model is a fine-tuned version of [microsoft/deberta-v3-small](https://huggingface.co/microsoft/deberta-v3-small) on an unknown dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.6675
23
+ - Accuracy: 0.667
24
+ - True Positive: 0.0
25
+ - False Negative: 1.0
26
+ - False Positive: 0.0
27
+ - True Negative: 1.0
28
+ - F1: 0.8002
29
+
30
+ ## Model description
31
+
32
+ More information needed
33
+
34
+ ## Intended uses & limitations
35
+
36
+ More information needed
37
+
38
+ ## Training and evaluation data
39
+
40
+ More information needed
41
+
42
+ ## Training procedure
43
+
44
+ ### Training hyperparameters
45
+
46
+ The following hyperparameters were used during training:
47
+ - learning_rate: 1e-05
48
+ - train_batch_size: 32
49
+ - eval_batch_size: 32
50
+ - seed: 42
51
+ - distributed_type: multi-GPU
52
+ - num_devices: 2
53
+ - total_train_batch_size: 64
54
+ - total_eval_batch_size: 64
55
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
56
+ - lr_scheduler_type: linear
57
+ - lr_scheduler_warmup_ratio: 0.1
58
+ - num_epochs: 2
59
+
60
+ ### Training results
61
+
62
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | True Positive | False Negative | False Positive | True Negative | F1 |
63
+ |:-------------:|:------:|:----:|:---------------:|:--------:|:-------------:|:--------------:|:--------------:|:-------------:|:------:|
64
+ | No log | 0.4375 | 7 | 0.7175 | 0.333 | 1.0 | 0.0 | 1.0 | 0.0 | 0.0 |
65
+ | No log | 0.875 | 14 | 0.6894 | 0.679 | 0.0871 | 0.9129 | 0.0255 | 0.9745 | 0.802 |
66
+ | No log | 1.3125 | 21 | 0.6765 | 0.667 | 0.0 | 1.0 | 0.0 | 1.0 | 0.8002 |
67
+ | No log | 1.75 | 28 | 0.6675 | 0.667 | 0.0 | 1.0 | 0.0 | 1.0 | 0.8002 |
68
+
69
+
70
+ ### Framework versions
71
+
72
+ - Transformers 4.45.1
73
+ - Pytorch 2.4.0+cu121
74
+ - Datasets 2.19.2
75
+ - Tokenizers 0.20.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffd8241387c1d9669db0759da54c3c6d29e03811436d785bf7b19a75e5ec3142
3
  size 283805756
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:073da594d2df46cd05943a98c1508bb9ca65e70e2edca3cd441b19cb6f4684cc
3
  size 283805756