Hugging Face's logo

doyoungkim
/
bert-base-uncased-finetuned-sst2

Text Classification
Transformers
PyTorch
TensorBoard
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
3
doyoungkim commited on
Commit
90b0ec5
•
1 Parent(s): 9d4b3ab

add model

Browse files
Files changed (21) hide show
  1. README.md +9 -12
  2. config.json +3 -1
  3. pytorch_model.bin +1 -1
  4. runs/Aug03_20-15-32_d227a27e506d/1628021767.3300974/events.out.tfevents.1628021767.d227a27e506d.62.1 +3 -0
  5. runs/Aug03_20-15-32_d227a27e506d/events.out.tfevents.1628021767.d227a27e506d.62.0 +3 -0
  6. runs/Aug03_21-17-38_d227a27e506d/1628025499.7737923/events.out.tfevents.1628025499.d227a27e506d.62.3 +3 -0
  7. runs/Aug03_21-17-38_d227a27e506d/events.out.tfevents.1628025499.d227a27e506d.62.2 +3 -0
  8. runs/Aug03_21-19-42_d227a27e506d/1628025604.694123/events.out.tfevents.1628025604.d227a27e506d.62.5 +3 -0
  9. runs/Aug03_21-19-42_d227a27e506d/events.out.tfevents.1628025604.d227a27e506d.62.4 +3 -0
  10. runs/Aug03_21-29-34_d227a27e506d/1628026210.6406155/events.out.tfevents.1628026210.d227a27e506d.62.7 +3 -0
  11. runs/Aug03_21-29-34_d227a27e506d/events.out.tfevents.1628026210.d227a27e506d.62.6 +3 -0
  12. runs/Aug03_21-31-28_d227a27e506d/1628026299.4263291/events.out.tfevents.1628026299.d227a27e506d.62.9 +3 -0
  13. runs/Aug03_21-31-28_d227a27e506d/events.out.tfevents.1628026299.d227a27e506d.62.8 +3 -0
  14. runs/Aug03_21-37-10_d227a27e506d/1628026640.4248846/events.out.tfevents.1628026640.d227a27e506d.62.11 +3 -0
  15. runs/Aug03_21-37-10_d227a27e506d/events.out.tfevents.1628026640.d227a27e506d.62.10 +3 -0
  16. runs/Aug03_21-38-20_d227a27e506d/1628026709.0479298/events.out.tfevents.1628026709.d227a27e506d.62.13 +3 -0
  17. runs/Aug03_21-38-20_d227a27e506d/events.out.tfevents.1628026709.d227a27e506d.62.12 +3 -0
  18. runs/Aug03_21-40-31_d227a27e506d/1628026840.2444737/events.out.tfevents.1628026840.d227a27e506d.62.15 +3 -0
  19. runs/Aug03_21-40-31_d227a27e506d/events.out.tfevents.1628026840.d227a27e506d.62.14 +3 -0
  20. runs/Aug03_21-40-31_d227a27e506d/events.out.tfevents.1628029930.d227a27e506d.62.16 +3 -0
  21. training_args.bin +1 -1
README.md CHANGED
@@ -9,17 +9,14 @@ metrics:
9
  model_index:
10
  - name: bert-base-uncased-finetuned-sst2
11
  results:
12
- - task:
13
- name: Text Classification
14
- type: text-classification
15
- dataset:
16
  name: glue
17
  type: glue
18
  args: sst2
19
  metric:
20
  name: Accuracy
21
  type: accuracy
22
- value: 0.930045871559633
23
  ---
24
 
25
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -29,8 +26,8 @@ should probably proofread and complete it, then remove this comment. -->
29
 
30
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the glue dataset.
31
  It achieves the following results on the evaluation set:
32
- - Loss: 0.3865
33
- - Accuracy: 0.9300
34
 
35
  ## Model description
36
 
@@ -61,11 +58,11 @@ The following hyperparameters were used during training:
61
 
62
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
63
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
64
- | 0.179 | 1.0 | 4210 | 0.2863 | 0.9197 |
65
- | 0.1251 | 2.0 | 8420 | 0.3202 | 0.9186 |
66
- | 0.0816 | 3.0 | 12630 | 0.3339 | 0.9243 |
67
- | 0.067 | 4.0 | 16840 | 0.3108 | 0.9289 |
68
- | 0.0337 | 5.0 | 21050 | 0.3865 | 0.9300 |
69
 
70
 
71
  ### Framework versions
 
9
  model_index:
10
  - name: bert-base-uncased-finetuned-sst2
11
  results:
12
+ - dataset:
 
 
 
13
  name: glue
14
  type: glue
15
  args: sst2
16
  metric:
17
  name: Accuracy
18
  type: accuracy
19
+ value: 0.9277522935779816
20
  ---
21
 
22
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
26
 
27
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the glue dataset.
28
  It achieves the following results on the evaluation set:
29
+ - Loss: 0.3167
30
+ - Accuracy: 0.9278
31
 
32
  ## Model description
33
 
 
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
60
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
61
+ | 0.1801 | 1.0 | 4210 | 0.3290 | 0.9083 |
62
+ | 0.1273 | 2.0 | 8420 | 0.3167 | 0.9278 |
63
+ | 0.0799 | 3.0 | 12630 | 0.3707 | 0.9255 |
64
+ | 0.0636 | 4.0 | 16840 | 0.3339 | 0.9278 |
65
+ | 0.04 | 5.0 | 21050 | 0.4060 | 0.9220 |
66
 
67
 
68
  ### Framework versions
config.json CHANGED
@@ -1,9 +1,10 @@
1
  {
2
  "_name_or_path": "bert-base-uncased",
3
  "architectures": [
4
- "BertForSequenceClassification"
5
  ],
6
  "attention_probs_dropout_prob": 0.1,
 
7
  "gradient_checkpointing": false,
8
  "hidden_act": "gelu",
9
  "hidden_dropout_prob": 0.1,
@@ -17,6 +18,7 @@
17
  "num_hidden_layers": 12,
18
  "pad_token_id": 0,
19
  "position_embedding_type": "absolute",
 
20
  "problem_type": "single_label_classification",
21
  "torch_dtype": "float32",
22
  "transformers_version": "4.9.1",
 
1
  {
2
  "_name_or_path": "bert-base-uncased",
3
  "architectures": [
4
+ "MyBertForSequenceClassification"
5
  ],
6
  "attention_probs_dropout_prob": 0.1,
7
+ "classifier_type": "log_soft",
8
  "gradient_checkpointing": false,
9
  "hidden_act": "gelu",
10
  "hidden_dropout_prob": 0.1,
 
18
  "num_hidden_layers": 12,
19
  "pad_token_id": 0,
20
  "position_embedding_type": "absolute",
21
+ "pretrained_model_name_or_path": "bert-base-uncased",
22
  "problem_type": "single_label_classification",
23
  "torch_dtype": "float32",
24
  "transformers_version": "4.9.1",
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:052c6d33600c9b6a44cef0dd71281258199d298978ff2da0d86f974ab4e5e5fb
3
  size 438019245
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c45e3d8b74d3ba5cc9fe8b13a829ee23fd5e73d758bce3c634e124b8c5c851d0
3
  size 438019245
runs/Aug03_20-15-32_d227a27e506d/1628021767.3300974/events.out.tfevents.1628021767.d227a27e506d.62.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6ae13070cf42213e468ed89f459419ab29cbb9a71df967dcd29d1c171f735cf
3
+ size 4203
runs/Aug03_20-15-32_d227a27e506d/events.out.tfevents.1628021767.d227a27e506d.62.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d629c6741fb0a45dfc491f9a7e9bf6e57541d264157c118d92e9db2e6d31d12
3
+ size 2931
runs/Aug03_21-17-38_d227a27e506d/1628025499.7737923/events.out.tfevents.1628025499.d227a27e506d.62.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f13dce0e4c4f9d9022bcf17a37f1364bac49531311da79da07dd6161d0a80c4d
3
+ size 4203
runs/Aug03_21-17-38_d227a27e506d/events.out.tfevents.1628025499.d227a27e506d.62.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d27caa86fdcc70db371acb3dba09e6533a43ae03ebd29a312aefa436e72e3b6
3
+ size 2972
runs/Aug03_21-19-42_d227a27e506d/1628025604.694123/events.out.tfevents.1628025604.d227a27e506d.62.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b89b3a43b65cf4381b7b3073e8ab380a47ac00eb2b5ca501eb593d5c8c22ba8
3
+ size 4203
runs/Aug03_21-19-42_d227a27e506d/events.out.tfevents.1628025604.d227a27e506d.62.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33c187ba06899643ec91eb8ba2869119c24caa9ed66ec305a3b845df51d4aa5a
3
+ size 2972
runs/Aug03_21-29-34_d227a27e506d/1628026210.6406155/events.out.tfevents.1628026210.d227a27e506d.62.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0c0438388618e6fd007f45864f71f271b625eb1011ac0c74b54e952ae0b563
3
+ size 4203
runs/Aug03_21-29-34_d227a27e506d/events.out.tfevents.1628026210.d227a27e506d.62.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e0285823fddaa6169f311925a0b6d75214ed5560b2439bde449a434389ff2ba
3
+ size 2972
runs/Aug03_21-31-28_d227a27e506d/1628026299.4263291/events.out.tfevents.1628026299.d227a27e506d.62.9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24aab6836f2beee86b49d3b6b52c9162bff864d86ce8203f94122e5bbeb65286
3
+ size 4203
runs/Aug03_21-31-28_d227a27e506d/events.out.tfevents.1628026299.d227a27e506d.62.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18d41e6df0409179c02dce7b9b4aed5085b2329d327c56f91f47d68ec2d55ded
3
+ size 2972
runs/Aug03_21-37-10_d227a27e506d/1628026640.4248846/events.out.tfevents.1628026640.d227a27e506d.62.11 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a37f28fad6961b24c003a0463daf66dcc1310be7404c0faeab3884b58a7fbc47
3
+ size 4203
runs/Aug03_21-37-10_d227a27e506d/events.out.tfevents.1628026640.d227a27e506d.62.10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e118fa328c067b9930261717cf8a2644976a95793ad974fb7a29903fbb8d902
3
+ size 2972
runs/Aug03_21-38-20_d227a27e506d/1628026709.0479298/events.out.tfevents.1628026709.d227a27e506d.62.13 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db968f6b410739f7234f4fd33269278dc5cee986f2fd39b9389ccb00eddaa04a
3
+ size 4203
runs/Aug03_21-38-20_d227a27e506d/events.out.tfevents.1628026709.d227a27e506d.62.12 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1384279b3917f70ad4fd1a288b9ce7c05c9149d94e341ac254fe9036e6d0c441
3
+ size 2972
runs/Aug03_21-40-31_d227a27e506d/1628026840.2444737/events.out.tfevents.1628026840.d227a27e506d.62.15 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ae061019c118bb96362a96161430d1eef9f5ff78fa4a8ba4f6cd01eb2ab0be6
3
+ size 4203
runs/Aug03_21-40-31_d227a27e506d/events.out.tfevents.1628026840.d227a27e506d.62.14 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c688627281c9f4bba6859ac75fc3af175361f7b919298b241a54ac0772ae13f3
3
+ size 11583
runs/Aug03_21-40-31_d227a27e506d/events.out.tfevents.1628029930.d227a27e506d.62.16 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9941dc90da7f4d51402b5894f956b693e0411cd68b5c4d36178a289d01bd42d
3
+ size 369
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:afc487aec15c8bd844ece4ffc3dc6f9d020e0ecee7b4aa2a0610967da220b418
3
  size 2671
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a76ec2eba6275d14f345c4b10064004176bd2792c45d7e077c411c952c44820
3
  size 2671