salbatarni commited on
Commit
1120910
1 Parent(s): 81066d8

Training in progress, step 65

Browse files
README.md ADDED
@@ -0,0 +1,90 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google-bert/bert-base-cased
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: bert_baseline_prompt_adherence_task3_fold1
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # bert_baseline_prompt_adherence_task3_fold1
15
+
16
+ This model is a fine-tuned version of [google-bert/bert-base-cased](https://huggingface.co/google-bert/bert-base-cased) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.3953
19
+ - Qwk: 0.5713
20
+ - Mse: 0.3957
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 2e-05
40
+ - train_batch_size: 16
41
+ - eval_batch_size: 16
42
+ - seed: 42
43
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
+ - lr_scheduler_type: linear
45
+ - num_epochs: 1
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
50
+ |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
51
+ | No log | 0.0308 | 2 | 1.5468 | 0.0 | 1.5470 |
52
+ | No log | 0.0615 | 4 | 0.9894 | 0.0062 | 0.9899 |
53
+ | No log | 0.0923 | 6 | 0.7177 | 0.1308 | 0.7184 |
54
+ | No log | 0.1231 | 8 | 0.5962 | 0.0090 | 0.5969 |
55
+ | No log | 0.1538 | 10 | 0.5955 | 0.0030 | 0.5963 |
56
+ | No log | 0.1846 | 12 | 0.5747 | 0.1211 | 0.5755 |
57
+ | No log | 0.2154 | 14 | 0.5424 | 0.0335 | 0.5431 |
58
+ | No log | 0.2462 | 16 | 0.5193 | 0.0423 | 0.5200 |
59
+ | No log | 0.2769 | 18 | 0.4807 | 0.1237 | 0.4815 |
60
+ | No log | 0.3077 | 20 | 0.4729 | 0.2731 | 0.4737 |
61
+ | No log | 0.3385 | 22 | 0.4694 | 0.4293 | 0.4701 |
62
+ | No log | 0.3692 | 24 | 0.4429 | 0.4729 | 0.4436 |
63
+ | No log | 0.4 | 26 | 0.4262 | 0.4577 | 0.4267 |
64
+ | No log | 0.4308 | 28 | 0.4314 | 0.4855 | 0.4319 |
65
+ | No log | 0.4615 | 30 | 0.4305 | 0.5004 | 0.4309 |
66
+ | No log | 0.4923 | 32 | 0.4624 | 0.5260 | 0.4629 |
67
+ | No log | 0.5231 | 34 | 0.4806 | 0.5487 | 0.4811 |
68
+ | No log | 0.5538 | 36 | 0.4851 | 0.5627 | 0.4856 |
69
+ | No log | 0.5846 | 38 | 0.4781 | 0.5647 | 0.4786 |
70
+ | No log | 0.6154 | 40 | 0.4385 | 0.5586 | 0.4390 |
71
+ | No log | 0.6462 | 42 | 0.4008 | 0.4961 | 0.4012 |
72
+ | No log | 0.6769 | 44 | 0.4215 | 0.4424 | 0.4219 |
73
+ | No log | 0.7077 | 46 | 0.4247 | 0.4297 | 0.4251 |
74
+ | No log | 0.7385 | 48 | 0.4050 | 0.4683 | 0.4054 |
75
+ | No log | 0.7692 | 50 | 0.3963 | 0.5180 | 0.3967 |
76
+ | No log | 0.8 | 52 | 0.4101 | 0.5579 | 0.4105 |
77
+ | No log | 0.8308 | 54 | 0.4164 | 0.5675 | 0.4168 |
78
+ | No log | 0.8615 | 56 | 0.4086 | 0.5617 | 0.4090 |
79
+ | No log | 0.8923 | 58 | 0.4033 | 0.5653 | 0.4037 |
80
+ | No log | 0.9231 | 60 | 0.4008 | 0.5653 | 0.4012 |
81
+ | No log | 0.9538 | 62 | 0.3973 | 0.5713 | 0.3977 |
82
+ | No log | 0.9846 | 64 | 0.3953 | 0.5713 | 0.3957 |
83
+
84
+
85
+ ### Framework versions
86
+
87
+ - Transformers 4.42.3
88
+ - Pytorch 2.1.2
89
+ - Datasets 2.20.0
90
+ - Tokenizers 0.19.1
config.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "google-bert/bert-base-cased",
3
+ "architectures": [
4
+ "BertForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifier_dropout": null,
8
+ "gradient_checkpointing": false,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "LABEL_0"
14
+ },
15
+ "initializer_range": 0.02,
16
+ "intermediate_size": 3072,
17
+ "label2id": {
18
+ "LABEL_0": 0
19
+ },
20
+ "layer_norm_eps": 1e-12,
21
+ "max_position_embeddings": 512,
22
+ "model_type": "bert",
23
+ "num_attention_heads": 12,
24
+ "num_hidden_layers": 12,
25
+ "pad_token_id": 0,
26
+ "position_embedding_type": "absolute",
27
+ "problem_type": "regression",
28
+ "torch_dtype": "float32",
29
+ "transformers_version": "4.42.3",
30
+ "type_vocab_size": 2,
31
+ "use_cache": true,
32
+ "vocab_size": 28996
33
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f750686d5a585e8dbf502f7b9baa9cf9f7522b0b16539a441bfb14033a846d89
3
+ size 433267692
runs/Aug22_09-38-15_4a91f28c1eab/events.out.tfevents.1724319507.4a91f28c1eab.34.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d780bca46640f487aaace997a9e534dc47ca582c785247bfe137b5a6b54f293a
3
+ size 16732
runs/Aug22_09-43-32_4a91f28c1eab/events.out.tfevents.1724319813.4a91f28c1eab.34.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba6e318c2d084abab07a0ce487d4a1a40a69a47c6b752f31635fd14904a10757
3
+ size 16732
runs/Aug22_09-48-51_4a91f28c1eab/events.out.tfevents.1724320132.4a91f28c1eab.34.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14cf319845c27eda78d0ad082f4fb4af2b09bd98647668d789c7c6b808747f61
3
+ size 16732
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:263a342bf0d5edaa29c754736bbc4869fbca52dd6cbfdf77060c84bac4d40026
3
+ size 5176