--- license: apache-2.0 base_model: google/flan-t5-small tags: - generated_from_trainer model-index: - name: classification_flan_t5_enriched results: [] --- # classification_flan_t5_enriched This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.5235 - Classification Report: precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.2400 0.5455 0.3333 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6866 0.8679 0.7667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6750 200 macro avg 0.3462 0.3640 0.3252 200 weighted avg 0.6557 0.6750 0.6372 200 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 7 - eval_batch_size: 7 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 20 ### Training results | Training Loss | Epoch | Step | Validation Loss | Classification Report | |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| | No log | 1.0 | 172 | 0.5962 | precision recall f1-score support ALLERGY 0.6471 0.9167 0.7586 12 ASSESSMENT 0.1429 0.0909 0.1111 11 CC 0.0000 0.0000 0.0000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.7556 0.7556 0.7556 45 GENHX 0.5000 0.8113 0.6187 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIS 0.0000 0.0000 0.0000 0 IMMUNITIVES 0.0000 0.0000 0.0000 0 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.4000 0.5000 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.2500 0.0714 0.1111 14 PASTSURGICAL 0.1739 0.5714 0.2667 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 Prevacid 0.0000 0.0000 0.0000 0 Psychiatric 0.0000 0.0000 0.0000 0 ROS 0.0000 0.0000 0.0000 17 Travel 0.0000 0.0000 0.0000 0 X 0.0000 0.0000 0.0000 0 accuracy 0.4900 200 macro avg 0.1206 0.1391 0.1201 200 weighted avg 0.4061 0.4900 0.4277 200 | | No log | 2.0 | 344 | 0.4113 | precision recall f1-score support ALLERGY 0.7857 0.9167 0.8462 12 ASSESSMENT 1.0000 0.0909 0.1667 11 CC 0.0000 0.0000 0.0000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8444 0.8444 0.8444 45 GENHX 0.4706 0.9057 0.6194 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8000 0.7273 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4545 0.3571 0.4000 14 PASTSURGICAL 0.6364 1.0000 0.7778 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 17 accuracy 0.5900 200 macro avg 0.2429 0.2457 0.2191 200 weighted avg 0.5043 0.5900 0.5057 200 | | 0.6004 | 3.0 | 516 | 0.3643 | precision recall f1-score support ALLERGY 0.8462 0.9167 0.8800 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2000 0.3636 0.2581 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.6618 0.8491 0.7438 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8000 0.8000 0.8000 10 Medicine 0.0000 0.0000 0.0000 0 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4211 0.5714 0.4848 14 PASTSURGICAL 0.6364 1.0000 0.7778 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 17 accuracy 0.6350 200 macro avg 0.2719 0.3159 0.2662 200 weighted avg 0.5562 0.6350 0.5810 200 | | 0.6004 | 4.0 | 688 | 0.3429 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5000 0.1818 0.2667 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1250 1.0000 0.2222 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.5897 0.8679 0.7023 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 Intra-Algeria 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5294 0.6429 0.5806 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.2353 0.3636 17 accuracy 0.6650 200 macro avg 0.3394 0.3323 0.2939 200 weighted avg 0.6436 0.6650 0.6205 200 | | 0.6004 | 5.0 | 860 | 0.3425 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.2000 0.0909 0.1250 11 CC 0.2632 0.4545 0.3333 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1000 1.0000 0.1818 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.7258 0.8491 0.7826 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.6429 0.6207 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.1765 0.2857 17 accuracy 0.6850 200 macro avg 0.3362 0.3743 0.3244 200 weighted avg 0.6663 0.6850 0.6537 200 | | 0.1554 | 6.0 | 1032 | 0.3941 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.2500 0.0909 0.1333 11 CC 0.0000 0.0000 0.0000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.5341 0.8868 0.6667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5000 0.7143 0.5882 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6500 200 macro avg 0.2806 0.2788 0.2681 200 weighted avg 0.5790 0.6500 0.5889 200 | | 0.1554 | 7.0 | 1204 | 0.4004 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.3333 0.2727 0.3000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1250 1.0000 0.2222 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8667 0.8667 0.8667 45 GENHX 0.6081 0.8491 0.7087 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1176 0.2000 17 X 0.0000 0.0000 0.0000 0 accuracy 0.6500 200 macro avg 0.3404 0.3313 0.2917 200 weighted avg 0.6434 0.6500 0.6104 200 | | 0.1554 | 8.0 | 1376 | 0.3968 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3000 0.2727 0.2857 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 G I 0.0000 0.0000 0.0000 0 GENHX 0.5897 0.8679 0.7023 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6667 0.5714 0.6154 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6600 200 macro avg 0.3145 0.3770 0.3081 200 weighted avg 0.6134 0.6600 0.6144 200 | | 0.0947 | 9.0 | 1548 | 0.4471 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2500 0.2727 0.2609 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1429 1.0000 0.2500 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.5875 0.8868 0.7068 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7500 0.6429 0.6923 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1176 0.2000 17 accuracy 0.6600 200 macro avg 0.3635 0.3902 0.3242 200 weighted avg 0.6335 0.6600 0.6120 200 | | 0.0947 | 10.0 | 1720 | 0.4346 | precision recall f1-score support ALLERGY 0.7857 0.9167 0.8462 12 ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.3333 0.5455 0.4138 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.6716 0.8491 0.7500 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6923 0.6429 0.6667 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6800 200 macro avg 0.3412 0.3677 0.3262 200 weighted avg 0.6483 0.6800 0.6425 200 | | 0.0947 | 11.0 | 1892 | 0.4606 | precision recall f1-score support ALLERGY 0.7857 0.9167 0.8462 12 ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.3000 0.2727 0.2857 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8696 0.8889 0.8791 45 GENHX 0.5823 0.8679 0.6970 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7500 0.6429 0.6923 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6600 200 macro avg 0.3402 0.3528 0.3205 200 weighted avg 0.6258 0.6600 0.6181 200 | | 0.0587 | 12.0 | 2064 | 0.4997 | precision recall f1-score support ALLERGY 0.7857 0.9167 0.8462 12 ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.3333 0.3636 0.3478 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.5921 0.8491 0.6977 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7143 0.7143 0.7143 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6700 200 macro avg 0.3716 0.3611 0.3250 200 weighted avg 0.6498 0.6700 0.6274 200 | | 0.0587 | 13.0 | 2236 | 0.4835 | precision recall f1-score support ALLERGY 0.8462 0.9167 0.8800 12 ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.2941 0.4545 0.3571 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6377 0.8302 0.7213 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.6429 0.6207 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.5000 0.1176 0.1905 17 accuracy 0.6600 200 macro avg 0.3271 0.3582 0.3166 200 weighted avg 0.6211 0.6600 0.6189 200 | | 0.0587 | 14.0 | 2408 | 0.4983 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.2857 0.3636 0.3200 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6133 0.8679 0.7187 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6650 200 macro avg 0.3397 0.3549 0.3224 200 weighted avg 0.6378 0.6650 0.6249 200 | | 0.0418 | 15.0 | 2580 | 0.4944 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3158 0.5455 0.4000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.6667 0.8679 0.7541 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7000 0.5000 0.5833 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6700 200 macro avg 0.3041 0.3400 0.2968 200 weighted avg 0.6283 0.6700 0.6290 200 | | 0.0418 | 16.0 | 2752 | 0.4890 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2308 0.5455 0.3243 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6866 0.8679 0.7667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7778 0.5000 0.6087 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.2353 0.3478 17 accuracy 0.6700 200 macro avg 0.3061 0.3417 0.3043 200 weighted avg 0.6359 0.6700 0.6336 200 | | 0.0418 | 17.0 | 2924 | 0.5106 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2381 0.4545 0.3125 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6389 0.8679 0.7360 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7000 0.5000 0.5833 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.5000 0.1176 0.1905 17 accuracy 0.6550 200 macro avg 0.2926 0.3318 0.2935 200 weighted avg 0.6041 0.6550 0.6096 200 | | 0.0289 | 18.0 | 3096 | 0.5188 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2500 0.5455 0.3429 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6970 0.8679 0.7731 53 GYNHX 0.5000 1.0000 0.6667 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6750 200 macro avg 0.3258 0.3900 0.3351 200 weighted avg 0.6330 0.6750 0.6354 200 | | 0.0289 | 19.0 | 3268 | 0.5195 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2500 0.5455 0.3429 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.6970 0.8679 0.7731 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6750 200 macro avg 0.3070 0.3434 0.3038 200 weighted avg 0.6321 0.6750 0.6337 200 | | 0.0289 | 20.0 | 3440 | 0.5235 | precision recall f1-score support ALLERGY 0.9167 0.9167 0.9167 12 ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.2400 0.5455 0.3333 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6866 0.8679 0.7667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17 accuracy 0.6750 200 macro avg 0.3462 0.3640 0.3252 200 weighted avg 0.6557 0.6750 0.6372 200 | ### Framework versions - Transformers 4.38.2 - Pytorch 2.1.0+cu121 - Datasets 2.18.0 - Tokenizers 0.15.2