Hugging Face's logo

antoineedy
/
bert-base-NER-finetuned-ner

Token Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
bert-base-NER-finetuned-ner / README.md
antoineedy's picture
antoineedy
new_test
0efea1b verified
preview code
|
raw
history blame contribute delete
23.1 kB
metadata
license: mit
base_model: dslim/bert-base-NER
tags:
  - generated_from_trainer
metrics:
  - accuracy
model-index:
  - name: bert-base-NER-finetuned-ner
    results: []

bert-base-NER-finetuned-ner

This model is a fine-tuned version of dslim/bert-base-NER on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.9704
  • 0 Precision: 0.9706
  • 0 Recall: 0.9413
  • 0 F1-score: 0.9558
  • 1 Precision: 0.8027
  • 1 Recall: 0.9205
  • 1 F1-score: 0.8575
  • 2 Precision: 0.7853
  • 2 Recall: 0.8165
  • 2 F1-score: 0.8006
  • 3 Precision: 0.7817
  • 3 Recall: 0.8603
  • 3 F1-score: 0.8191
  • Accuracy: 0.9272
  • Macro avg Precision: 0.8351
  • Macro avg Recall: 0.8847
  • Macro avg F1-score: 0.8583
  • Weighted avg Precision: 0.9313
  • Weighted avg Recall: 0.9272
  • Weighted avg F1-score: 0.9285

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 60

Training results

Training Loss Epoch Step Validation Loss 0 Precision 0 Recall 0 F1-score 1 Precision 1 Recall 1 F1-score 2 Precision 2 Recall 2 F1-score 3 Precision 3 Recall 3 F1-score Accuracy Macro avg Precision Macro avg Recall Macro avg F1-score Weighted avg Precision Weighted avg Recall Weighted avg F1-score
No log 1.0 67 0.3241 0.9901 0.8116 0.8920 0.5586 0.9694 0.7088 0.4424 0.8807 0.5890 0.6615 0.8696 0.7514 0.8343 0.6631 0.8829 0.7353 0.8979 0.8343 0.8495
No log 2.0 134 0.3219 0.9882 0.8544 0.9164 0.6282 0.9480 0.7556 0.5375 0.8318 0.6531 0.6460 0.9106 0.7558 0.8665 0.7000 0.8862 0.7702 0.9064 0.8665 0.8763
No log 3.0 201 0.3126 0.9927 0.8353 0.9072 0.5873 0.9725 0.7323 0.5213 0.8624 0.6498 0.6578 0.9199 0.7671 0.8561 0.6898 0.8975 0.7641 0.9062 0.8561 0.8677
No log 4.0 268 0.3805 0.9851 0.8936 0.9371 0.7105 0.9419 0.8100 0.6166 0.8410 0.7115 0.7001 0.9218 0.7958 0.8979 0.7531 0.8996 0.8136 0.9196 0.8979 0.9035
No log 5.0 335 0.4058 0.9839 0.9028 0.9416 0.6786 0.9587 0.7947 0.6887 0.8593 0.7646 0.7718 0.9069 0.8339 0.9064 0.7807 0.9069 0.8337 0.9246 0.9064 0.9110
No log 6.0 402 0.4349 0.9833 0.9130 0.9468 0.7246 0.9373 0.8173 0.6786 0.8716 0.7631 0.7649 0.9088 0.8306 0.9130 0.7878 0.9077 0.8395 0.9275 0.9130 0.9169
No log 7.0 469 0.4379 0.9839 0.9184 0.9500 0.7308 0.9465 0.8248 0.7072 0.8716 0.7808 0.7755 0.9069 0.8361 0.9179 0.7994 0.9108 0.8479 0.9308 0.9179 0.9214
0.2085 8.0 536 0.4750 0.9862 0.8964 0.9391 0.6702 0.9694 0.7925 0.7038 0.8502 0.7701 0.7369 0.9181 0.8176 0.9028 0.7743 0.9085 0.8298 0.9236 0.9028 0.9079
0.2085 9.0 603 0.5353 0.9817 0.9225 0.9512 0.7443 0.9526 0.8357 0.7342 0.8532 0.7893 0.7751 0.9050 0.8351 0.9207 0.8088 0.9083 0.8528 0.9315 0.9207 0.9236
0.2085 10.0 670 0.5730 0.9786 0.9325 0.9550 0.7920 0.9434 0.8611 0.7413 0.8502 0.7920 0.7722 0.8901 0.8270 0.9263 0.8211 0.9040 0.8588 0.9338 0.9263 0.9285
0.2085 11.0 737 0.5801 0.9787 0.9199 0.9484 0.7404 0.9419 0.8291 0.7199 0.8410 0.7757 0.7679 0.8994 0.8285 0.9166 0.8017 0.9005 0.8454 0.9276 0.9166 0.9197
0.2085 12.0 804 0.7227 0.9675 0.9526 0.96 0.8496 0.8807 0.8649 0.8170 0.7920 0.8043 0.7921 0.8939 0.8399 0.9337 0.8565 0.8798 0.8673 0.9356 0.9337 0.9343
0.2085 13.0 871 0.6296 0.9744 0.9421 0.9579 0.8331 0.9159 0.8725 0.7568 0.8471 0.7994 0.7794 0.8883 0.8303 0.9309 0.8359 0.8983 0.8650 0.9356 0.9309 0.9325
0.2085 14.0 938 0.7074 0.9728 0.9397 0.9559 0.8070 0.9205 0.8600 0.7690 0.8349 0.8006 0.7804 0.8734 0.8243 0.9278 0.8323 0.8921 0.8602 0.9326 0.9278 0.9293
0.0385 15.0 1005 0.7392 0.9714 0.9441 0.9576 0.8425 0.8914 0.8663 0.7634 0.8287 0.7947 0.7721 0.8957 0.8293 0.9299 0.8373 0.8900 0.8620 0.9340 0.9299 0.9313
0.0385 16.0 1072 0.7589 0.9741 0.9399 0.9567 0.8003 0.9190 0.8555 0.7604 0.8349 0.7959 0.7876 0.8771 0.8300 0.9281 0.8306 0.8927 0.8595 0.9331 0.9281 0.9297
0.0385 17.0 1139 0.7045 0.9724 0.9380 0.9549 0.7847 0.9251 0.8491 0.7624 0.8440 0.8012 0.8056 0.8641 0.8338 0.9266 0.8313 0.8928 0.8597 0.9318 0.9266 0.9282
0.0385 18.0 1206 0.7735 0.9698 0.9437 0.9566 0.8043 0.9174 0.8571 0.7721 0.8287 0.7994 0.8074 0.8510 0.8286 0.9286 0.8384 0.8852 0.8604 0.9322 0.9286 0.9298
0.0385 19.0 1273 0.7184 0.9735 0.9399 0.9564 0.8150 0.9159 0.8625 0.7439 0.8440 0.7908 0.7863 0.8771 0.8292 0.9282 0.8297 0.8942 0.8597 0.9332 0.9282 0.9298
0.0385 20.0 1340 0.7814 0.9741 0.9341 0.9537 0.7875 0.9235 0.8501 0.7535 0.8226 0.7865 0.7581 0.8696 0.8101 0.9229 0.8183 0.8875 0.8501 0.9293 0.9229 0.9249
0.0385 21.0 1407 0.8279 0.9696 0.9445 0.9569 0.8201 0.9128 0.8640 0.7768 0.8196 0.7976 0.7880 0.8585 0.8217 0.9289 0.8386 0.8838 0.8601 0.9323 0.9289 0.9301
0.0385 22.0 1474 0.7268 0.9724 0.9332 0.9524 0.7704 0.9388 0.8463 0.7647 0.8349 0.7982 0.7818 0.8473 0.8132 0.9224 0.8223 0.8885 0.8525 0.9287 0.9224 0.9243
0.0127 23.0 1541 0.8197 0.9698 0.9445 0.9570 0.8078 0.9190 0.8598 0.7928 0.8073 0.8 0.7973 0.8641 0.8293 0.9294 0.8419 0.8837 0.8615 0.9327 0.9294 0.9305
0.0127 24.0 1608 0.8221 0.9722 0.9447 0.9582 0.8197 0.9037 0.8596 0.7718 0.8379 0.8035 0.7933 0.8790 0.8339 0.9307 0.8392 0.8913 0.8638 0.9344 0.9307 0.9320
0.0127 25.0 1675 0.8098 0.9735 0.9373 0.9550 0.7766 0.9358 0.8488 0.7928 0.8073 0.8 0.7809 0.8696 0.8229 0.9257 0.8310 0.8875 0.8567 0.9314 0.9257 0.9274
0.0127 26.0 1742 0.8023 0.9710 0.9404 0.9554 0.7897 0.9358 0.8565 0.7813 0.8196 0.8 0.8035 0.8529 0.8275 0.9275 0.8364 0.8872 0.8599 0.9319 0.9275 0.9288
0.0127 27.0 1809 0.7750 0.9748 0.9373 0.9557 0.7897 0.9358 0.8565 0.7591 0.8287 0.7924 0.7963 0.8808 0.8364 0.9276 0.8300 0.8957 0.8603 0.9333 0.9276 0.9293
0.0127 28.0 1876 0.9205 0.9673 0.9465 0.9568 0.8220 0.9037 0.8609 0.7861 0.7982 0.7921 0.7925 0.8603 0.8250 0.9288 0.8420 0.8772 0.8587 0.9314 0.9288 0.9297
0.0127 29.0 1943 0.7887 0.9726 0.9376 0.9548 0.7695 0.9343 0.8439 0.7756 0.8349 0.8041 0.8057 0.8492 0.8268 0.9256 0.8308 0.8890 0.8574 0.9311 0.9256 0.9273
0.0052 30.0 2010 0.8106 0.9778 0.9371 0.9570 0.7861 0.9327 0.8531 0.7658 0.8502 0.8058 0.7897 0.8883 0.8361 0.9288 0.8299 0.9021 0.8630 0.9351 0.9288 0.9307
0.0052 31.0 2077 0.8659 0.9699 0.9421 0.9558 0.8022 0.9113 0.8533 0.7929 0.8196 0.8060 0.7922 0.8734 0.8308 0.9281 0.8393 0.8866 0.8615 0.9319 0.9281 0.9293
0.0052 32.0 2144 0.8154 0.9722 0.9389 0.9553 0.7878 0.9251 0.8509 0.7768 0.8410 0.8076 0.7986 0.8641 0.8301 0.9272 0.8339 0.8923 0.8610 0.9321 0.9272 0.9287
0.0052 33.0 2211 0.8569 0.9727 0.9432 0.9577 0.8086 0.9174 0.8596 0.7878 0.8287 0.8077 0.7953 0.8827 0.8367 0.9307 0.8411 0.8930 0.8654 0.9347 0.9307 0.9320
0.0052 34.0 2278 0.8868 0.9705 0.9432 0.9566 0.8011 0.9113 0.8526 0.7843 0.8226 0.8030 0.7976 0.8659 0.8304 0.9285 0.8384 0.8858 0.8607 0.9323 0.9285 0.9298
0.0052 35.0 2345 0.8586 0.9745 0.9412 0.9575 0.8021 0.9235 0.8586 0.7771 0.8318 0.8035 0.79 0.8827 0.8338 0.9298 0.8359 0.8948 0.8634 0.9346 0.9298 0.9313
0.0052 36.0 2412 0.9288 0.9698 0.9449 0.9572 0.8157 0.9067 0.8588 0.7864 0.8104 0.7982 0.7825 0.8641 0.8212 0.9286 0.8386 0.8815 0.8588 0.9320 0.9286 0.9298
0.0052 37.0 2479 0.9396 0.9684 0.9460 0.9570 0.8186 0.9037 0.8590 0.7824 0.8135 0.7976 0.7917 0.8566 0.8229 0.9288 0.8403 0.8799 0.8591 0.9317 0.9288 0.9298
0.0032 38.0 2546 0.9108 0.9706 0.9408 0.9555 0.8014 0.9067 0.8508 0.7743 0.8287 0.8006 0.7862 0.8696 0.8258 0.9268 0.8331 0.8865 0.8582 0.9310 0.9268 0.9282
0.0032 39.0 2613 0.8132 0.9757 0.9306 0.9526 0.7853 0.9174 0.8463 0.7249 0.8379 0.7773 0.7700 0.8976 0.8289 0.9224 0.8140 0.8959 0.8513 0.9299 0.9224 0.9247
0.0032 40.0 2680 0.9634 0.9692 0.9421 0.9554 0.8033 0.9052 0.8512 0.7876 0.8165 0.8018 0.7825 0.8641 0.8212 0.9266 0.8356 0.8820 0.8574 0.9304 0.9266 0.9279
0.0032 41.0 2747 0.9024 0.9711 0.9387 0.9546 0.7937 0.9174 0.8511 0.7655 0.8287 0.7959 0.7840 0.8585 0.8196 0.9253 0.8286 0.8858 0.8553 0.9301 0.9253 0.9269
0.0032 42.0 2814 0.9623 0.9682 0.9456 0.9567 0.8217 0.9021 0.8601 0.7922 0.8043 0.7982 0.7795 0.8622 0.8187 0.9283 0.8404 0.8786 0.8584 0.9314 0.9283 0.9294
0.0032 43.0 2881 0.9335 0.9692 0.9441 0.9565 0.8148 0.9083 0.8590 0.7811 0.8073 0.7940 0.7817 0.8603 0.8191 0.9278 0.8367 0.8800 0.8572 0.9312 0.9278 0.9290
0.0032 44.0 2948 0.8909 0.9714 0.9380 0.9544 0.7924 0.9220 0.8523 0.7642 0.8226 0.7923 0.7817 0.8603 0.8191 0.9250 0.8274 0.8857 0.8546 0.9300 0.9250 0.9266
0.0026 45.0 3015 0.9011 0.9711 0.9393 0.9549 0.7900 0.9205 0.8503 0.7876 0.8165 0.8018 0.7811 0.8641 0.8205 0.9259 0.8325 0.8851 0.8569 0.9306 0.9259 0.9274
0.0026 46.0 3082 0.9105 0.9709 0.9387 0.9546 0.7921 0.9205 0.8515 0.7801 0.8135 0.7964 0.7785 0.8641 0.8191 0.9253 0.8304 0.8842 0.8554 0.9301 0.9253 0.9268
0.0026 47.0 3149 0.9380 0.9698 0.9404 0.9549 0.7936 0.9113 0.8484 0.7811 0.8073 0.7940 0.7808 0.8622 0.8195 0.9253 0.8313 0.8803 0.8542 0.9296 0.9253 0.9267
0.0026 48.0 3216 0.9258 0.9702 0.9393 0.9545 0.7846 0.9190 0.8465 0.7843 0.8226 0.8030 0.7849 0.8492 0.8157 0.9249 0.8310 0.8825 0.8549 0.9295 0.9249 0.9264
0.0026 49.0 3283 0.9463 0.9697 0.9404 0.9548 0.7918 0.9128 0.8480 0.7836 0.8196 0.8012 0.7880 0.8585 0.8217 0.9257 0.8333 0.8828 0.8564 0.9300 0.9257 0.9271
0.0026 50.0 3350 0.9205 0.9708 0.9406 0.9555 0.7939 0.9190 0.8519 0.7895 0.8257 0.8072 0.7836 0.8566 0.8185 0.9266 0.8345 0.8855 0.8583 0.9310 0.9266 0.9280
0.0026 51.0 3417 0.9339 0.9702 0.9412 0.9555 0.8024 0.9128 0.8541 0.7872 0.8257 0.8060 0.7808 0.8622 0.8195 0.9269 0.8352 0.8855 0.8587 0.9310 0.9269 0.9283
0.0026 52.0 3484 0.9439 0.9712 0.9413 0.9560 0.7995 0.9205 0.8557 0.7959 0.8226 0.8090 0.7808 0.8622 0.8195 0.9276 0.8368 0.8867 0.8601 0.9319 0.9276 0.9290
0.0013 53.0 3551 0.9354 0.9715 0.9406 0.9558 0.7974 0.9266 0.8571 0.7855 0.8287 0.8065 0.7863 0.8566 0.8200 0.9275 0.8352 0.8881 0.8599 0.9319 0.9275 0.9289
0.0013 54.0 3618 0.9541 0.9715 0.9404 0.9557 0.7992 0.9251 0.8575 0.7832 0.8287 0.8053 0.7840 0.8585 0.8196 0.9273 0.8345 0.8882 0.8595 0.9318 0.9273 0.9288
0.0013 55.0 3685 0.9586 0.9715 0.9402 0.9556 0.7984 0.9266 0.8577 0.7820 0.8226 0.8018 0.7810 0.8566 0.8171 0.9269 0.8332 0.8865 0.8581 0.9314 0.9269 0.9284
0.0013 56.0 3752 0.9737 0.9690 0.9413 0.9549 0.8005 0.9083 0.8510 0.7853 0.8165 0.8006 0.7814 0.8585 0.8181 0.9259 0.8340 0.8811 0.8562 0.9298 0.9259 0.9272
0.0013 57.0 3819 0.9620 0.9695 0.9404 0.9547 0.7997 0.9098 0.8512 0.7807 0.8165 0.7982 0.7795 0.8622 0.8187 0.9256 0.8323 0.8822 0.8557 0.9298 0.9256 0.9270
0.0013 58.0 3886 0.9616 0.9697 0.9404 0.9548 0.7997 0.9159 0.8539 0.7853 0.8165 0.8006 0.7787 0.8585 0.8167 0.9259 0.8334 0.8828 0.8565 0.9301 0.9259 0.9273
0.0013 59.0 3953 0.9692 0.9701 0.9412 0.9554 0.8021 0.9174 0.8559 0.7830 0.8165 0.7994 0.7814 0.8585 0.8181 0.9266 0.8341 0.8834 0.8572 0.9307 0.9266 0.9280
0.001 60.0 4020 0.9704 0.9706 0.9413 0.9558 0.8027 0.9205 0.8575 0.7853 0.8165 0.8006 0.7817 0.8603 0.8191 0.9272 0.8351 0.8847 0.8583 0.9313 0.9272 0.9285

Framework versions

  • Transformers 4.38.2
  • Pytorch 2.2.1+cu121
  • Datasets 2.18.0
  • Tokenizers 0.15.2