Hugging Face's logo

salbatarni
/
bert_baseline_prompt_adherence_task4_fold1

TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files Metrics Community
salbatarni commited on
Commit
98225ae
•
1 Parent(s): 9803091

Training in progress, step 67

Browse files
Files changed (11) hide show
  1. README.md +91 -0
  2. config.json +33 -0
  3. model.safetensors +3 -0
  4. runs/Aug22_09-41-53_b098a78ba869/events.out.tfevents.1724319714.b098a78ba869.24.0 +3 -0
  5. runs/Aug22_09-46-37_b098a78ba869/events.out.tfevents.1724319997.b098a78ba869.24.1 +3 -0
  6. runs/Aug22_09-51-18_b098a78ba869/events.out.tfevents.1724320279.b098a78ba869.24.2 +3 -0
  7. runs/Aug22_09-55-57_b098a78ba869/events.out.tfevents.1724320558.b098a78ba869.24.3 +3 -0
  8. runs/Aug22_10-00-34_b098a78ba869/events.out.tfevents.1724320834.b098a78ba869.24.4 +3 -0
  9. runs/Aug22_10-05-10_b098a78ba869/events.out.tfevents.1724321111.b098a78ba869.24.5 +3 -0
  10. runs/Aug22_10-10-00_b098a78ba869/events.out.tfevents.1724321400.b098a78ba869.24.6 +3 -0
  11. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,91 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google-bert/bert-base-cased
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: bert_baseline_prompt_adherence_task4_fold0
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # bert_baseline_prompt_adherence_task4_fold0
15
+
16
+ This model is a fine-tuned version of [google-bert/bert-base-cased](https://huggingface.co/google-bert/bert-base-cased) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.4271
19
+ - Qwk: 0.6387
20
+ - Mse: 0.4239
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 2e-05
40
+ - train_batch_size: 16
41
+ - eval_batch_size: 16
42
+ - seed: 42
43
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
+ - lr_scheduler_type: linear
45
+ - num_epochs: 1
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
50
+ |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
51
+ | No log | 0.0299 | 2 | 1.2960 | 0.0 | 1.2930 |
52
+ | No log | 0.0597 | 4 | 0.9177 | 0.0 | 0.9154 |
53
+ | No log | 0.0896 | 6 | 0.8271 | 0.3838 | 0.8254 |
54
+ | No log | 0.1194 | 8 | 0.7326 | 0.3465 | 0.7313 |
55
+ | No log | 0.1493 | 10 | 0.6599 | 0.3581 | 0.6586 |
56
+ | No log | 0.1791 | 12 | 0.6243 | 0.3717 | 0.6227 |
57
+ | No log | 0.2090 | 14 | 0.6024 | 0.3919 | 0.6005 |
58
+ | No log | 0.2388 | 16 | 0.5293 | 0.3990 | 0.5275 |
59
+ | No log | 0.2687 | 18 | 0.5958 | 0.6599 | 0.5946 |
60
+ | No log | 0.2985 | 20 | 0.5865 | 0.6470 | 0.5851 |
61
+ | No log | 0.3284 | 22 | 0.4997 | 0.6200 | 0.4975 |
62
+ | No log | 0.3582 | 24 | 0.4852 | 0.4550 | 0.4825 |
63
+ | No log | 0.3881 | 26 | 0.5626 | 0.3360 | 0.5596 |
64
+ | No log | 0.4179 | 28 | 0.6943 | 0.2663 | 0.6911 |
65
+ | No log | 0.4478 | 30 | 0.6648 | 0.2753 | 0.6616 |
66
+ | No log | 0.4776 | 32 | 0.5340 | 0.3669 | 0.5308 |
67
+ | No log | 0.5075 | 34 | 0.4475 | 0.5778 | 0.4444 |
68
+ | No log | 0.5373 | 36 | 0.4749 | 0.6546 | 0.4720 |
69
+ | No log | 0.5672 | 38 | 0.5331 | 0.6635 | 0.5306 |
70
+ | No log | 0.5970 | 40 | 0.5591 | 0.6712 | 0.5569 |
71
+ | No log | 0.6269 | 42 | 0.5329 | 0.6517 | 0.5307 |
72
+ | No log | 0.6567 | 44 | 0.4773 | 0.6521 | 0.4749 |
73
+ | No log | 0.6866 | 46 | 0.4526 | 0.5105 | 0.4499 |
74
+ | No log | 0.7164 | 48 | 0.4667 | 0.4248 | 0.4638 |
75
+ | No log | 0.7463 | 50 | 0.4597 | 0.4232 | 0.4567 |
76
+ | No log | 0.7761 | 52 | 0.4413 | 0.4921 | 0.4382 |
77
+ | No log | 0.8060 | 54 | 0.4265 | 0.5327 | 0.4234 |
78
+ | No log | 0.8358 | 56 | 0.4218 | 0.5857 | 0.4188 |
79
+ | No log | 0.8657 | 58 | 0.4221 | 0.6155 | 0.4191 |
80
+ | No log | 0.8955 | 60 | 0.4244 | 0.6239 | 0.4213 |
81
+ | No log | 0.9254 | 62 | 0.4273 | 0.6354 | 0.4242 |
82
+ | No log | 0.9552 | 64 | 0.4272 | 0.6387 | 0.4241 |
83
+ | No log | 0.9851 | 66 | 0.4271 | 0.6387 | 0.4239 |
84
+
85
+
86
+ ### Framework versions
87
+
88
+ - Transformers 4.42.3
89
+ - Pytorch 2.1.2
90
+ - Datasets 2.20.0
91
+ - Tokenizers 0.19.1
config.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "google-bert/bert-base-cased",
3
+ "architectures": [
4
+ "BertForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifier_dropout": null,
8
+ "gradient_checkpointing": false,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "LABEL_0"
14
+ },
15
+ "initializer_range": 0.02,
16
+ "intermediate_size": 3072,
17
+ "label2id": {
18
+ "LABEL_0": 0
19
+ },
20
+ "layer_norm_eps": 1e-12,
21
+ "max_position_embeddings": 512,
22
+ "model_type": "bert",
23
+ "num_attention_heads": 12,
24
+ "num_hidden_layers": 12,
25
+ "pad_token_id": 0,
26
+ "position_embedding_type": "absolute",
27
+ "problem_type": "regression",
28
+ "torch_dtype": "float32",
29
+ "transformers_version": "4.42.3",
30
+ "type_vocab_size": 2,
31
+ "use_cache": true,
32
+ "vocab_size": 28996
33
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c75e15db89f4aa2dc6d5f2f861b23f4f68fc6941e964f5e410af50087ace1eb8
3
+ size 433267692
runs/Aug22_09-41-53_b098a78ba869/events.out.tfevents.1724319714.b098a78ba869.24.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1dcac9650b5450fbaadc3ad68ba6b6b82ae838a7cafdd92a6b5535dd4d6e9f4b
3
+ size 16732
runs/Aug22_09-46-37_b098a78ba869/events.out.tfevents.1724319997.b098a78ba869.24.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcd4d8ff15d7594fdc959841620169c24a65b0c548c6adbd108cc9812cb87616
3
+ size 16732
runs/Aug22_09-51-18_b098a78ba869/events.out.tfevents.1724320279.b098a78ba869.24.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf26d8a0f6ae069f31804c48a0a2dedbf323023d7a090740e3c367f51a258191
3
+ size 16732
runs/Aug22_09-55-57_b098a78ba869/events.out.tfevents.1724320558.b098a78ba869.24.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:426405c5b76207abc1880d13df1dcaae4adddad6078797134e721b0c6a699e77
3
+ size 16732
runs/Aug22_10-00-34_b098a78ba869/events.out.tfevents.1724320834.b098a78ba869.24.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7c7e52495af62293f44fb984c90f98bb80087c70dbdcf065bacd830574649f5
3
+ size 16732
runs/Aug22_10-05-10_b098a78ba869/events.out.tfevents.1724321111.b098a78ba869.24.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dea266919544dd904fbb824ca3523a03bcbe01f3cf5e34f859c61b08d968bc13
3
+ size 17090
runs/Aug22_10-10-00_b098a78ba869/events.out.tfevents.1724321400.b098a78ba869.24.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f34e647343d8320afc9bc146f13635706f9ef6ae2447d3a1266ae9372306c81e
3
+ size 17090
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:198651907d25898cd28bc5ce911dfc639917f9273cee46672c6375c611301b30
3
+ size 5176