ricardo-filho commited on
Commit
d9dc71b
1 Parent(s): f3bb1db

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +102 -102
README.md CHANGED
@@ -14,143 +14,143 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.3308
18
- - Aerospacemanufacturer Precision: 0.8117
19
- - Aerospacemanufacturer Recall: 0.9058
20
- - Aerospacemanufacturer F1: 0.8562
21
  - Aerospacemanufacturer Number: 138
22
- - Anatomicalstructure Precision: 0.716
23
- - Anatomicalstructure Recall: 0.7885
24
- - Anatomicalstructure F1: 0.7505
25
  - Anatomicalstructure Number: 227
26
- - Artwork Precision: 0.6028
27
- - Artwork Recall: 0.6489
28
- - Artwork F1: 0.625
29
  - Artwork Number: 131
30
- - Artist Precision: 0.7838
31
- - Artist Recall: 0.8252
32
- - Artist F1: 0.8040
33
  - Artist Number: 1722
34
- - Athlete Precision: 0.7835
35
- - Athlete Recall: 0.7552
36
- - Athlete F1: 0.7691
37
  - Athlete Number: 719
38
- - Carmanufacturer Precision: 0.7953
39
- - Carmanufacturer Recall: 0.8553
40
- - Carmanufacturer F1: 0.8242
41
  - Carmanufacturer Number: 159
42
- - Cleric Precision: 0.6630
43
- - Cleric Recall: 0.5970
44
- - Cleric F1: 0.6283
45
  - Cleric Number: 201
46
- - Clothing Precision: 0.6296
47
- - Clothing Recall: 0.6641
48
- - Clothing F1: 0.6464
49
  - Clothing Number: 128
50
- - Disease Precision: 0.6961
51
- - Disease Recall: 0.7172
52
- - Disease F1: 0.7065
53
  - Disease Number: 198
54
- - Drink Precision: 0.8
55
  - Drink Recall: 0.8112
56
- - Drink F1: 0.8056
57
  - Drink Number: 143
58
- - Facility Precision: 0.6849
59
- - Facility Recall: 0.7304
60
- - Facility F1: 0.7069
61
  - Facility Number: 497
62
- - Food Precision: 0.7156
63
- - Food Recall: 0.7056
64
- - Food F1: 0.7106
65
  - Food Number: 214
66
- - Humansettlement Precision: 0.8631
67
- - Humansettlement Recall: 0.8845
68
- - Humansettlement F1: 0.8737
69
  - Humansettlement Number: 1689
70
- - Medicalprocedure Precision: 0.7852
71
- - Medicalprocedure Recall: 0.7465
72
- - Medicalprocedure F1: 0.7653
73
  - Medicalprocedure Number: 142
74
- - Medication/vaccine Precision: 0.7602
75
- - Medication/vaccine Recall: 0.84
76
- - Medication/vaccine F1: 0.7981
77
  - Medication/vaccine Number: 200
78
- - Musicalgrp Precision: 0.7601
79
- - Musicalgrp Recall: 0.8091
80
- - Musicalgrp F1: 0.7839
81
  - Musicalgrp Number: 372
82
- - Musicalwork Precision: 0.7506
83
- - Musicalwork Recall: 0.7617
84
- - Musicalwork F1: 0.7561
85
  - Musicalwork Number: 407
86
- - Org Precision: 0.6943
87
- - Org Recall: 0.7151
88
- - Org F1: 0.7046
89
  - Org Number: 667
90
- - Otherloc Precision: 0.7767
91
- - Otherloc Recall: 0.7455
92
- - Otherloc F1: 0.7608
93
  - Otherloc Number: 224
94
- - Otherper Precision: 0.5351
95
- - Otherper Recall: 0.5588
96
- - Otherper F1: 0.5467
97
  - Otherper Number: 859
98
- - Otherprod Precision: 0.6453
99
- - Otherprod Recall: 0.6513
100
- - Otherprod F1: 0.6483
101
  - Otherprod Number: 433
102
- - Politician Precision: 0.6277
103
- - Politician Recall: 0.6153
104
- - Politician F1: 0.6214
105
  - Politician Number: 603
106
- - Privatecorp Precision: 0.8981
107
- - Privatecorp Recall: 0.7519
108
- - Privatecorp F1: 0.8186
109
  - Privatecorp Number: 129
110
- - Publiccorp Precision: 0.7362
111
- - Publiccorp Recall: 0.7695
112
- - Publiccorp F1: 0.7525
113
  - Publiccorp Number: 243
114
- - Scientist Precision: 0.5178
115
- - Scientist Recall: 0.5397
116
- - Scientist F1: 0.5285
117
  - Scientist Number: 189
118
- - Software Precision: 0.7806
119
- - Software Recall: 0.7883
120
- - Software F1: 0.7844
121
  - Software Number: 307
122
- - Sportsgrp Precision: 0.8804
123
- - Sportsgrp Recall: 0.8987
124
- - Sportsgrp F1: 0.8895
125
  - Sportsgrp Number: 385
126
- - Sportsmanager Precision: 0.6863
127
- - Sportsmanager Recall: 0.7216
128
- - Sportsmanager F1: 0.7035
129
  - Sportsmanager Number: 194
130
- - Station Precision: 0.7696
131
  - Station Recall: 0.8093
132
- - Station F1: 0.7889
133
  - Station Number: 194
134
- - Symptom Precision: 0.7333
135
- - Symptom Recall: 0.7674
136
- - Symptom F1: 0.7500
137
  - Symptom Number: 129
138
- - Vehicle Precision: 0.6471
139
- - Vehicle Recall: 0.6942
140
- - Vehicle F1: 0.6698
141
  - Vehicle Number: 206
142
- - Visualwork Precision: 0.7917
143
- - Visualwork Recall: 0.8225
144
- - Visualwork F1: 0.8068
145
  - Visualwork Number: 693
146
- - Writtenwork Precision: 0.7255
147
- - Writtenwork Recall: 0.7229
148
- - Writtenwork F1: 0.7242
149
  - Writtenwork Number: 563
150
- - Overall Precision: 0.7404
151
- - Overall Recall: 0.7600
152
- - Overall F1: 0.7501
153
- - Overall Accuracy: 0.9437
154
 
155
  ## Model description
156
 
 
14
 
15
  This model is a fine-tuned version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.2148
18
+ - Aerospacemanufacturer Precision: 0.7073
19
+ - Aerospacemanufacturer Recall: 0.8406
20
+ - Aerospacemanufacturer F1: 0.7682
21
  - Aerospacemanufacturer Number: 138
22
+ - Anatomicalstructure Precision: 0.6762
23
+ - Anatomicalstructure Recall: 0.7269
24
+ - Anatomicalstructure F1: 0.7006
25
  - Anatomicalstructure Number: 227
26
+ - Artwork Precision: 0.5802
27
+ - Artwork Recall: 0.5802
28
+ - Artwork F1: 0.5802
29
  - Artwork Number: 131
30
+ - Artist Precision: 0.7565
31
+ - Artist Recall: 0.7938
32
+ - Artist F1: 0.7747
33
  - Artist Number: 1722
34
+ - Athlete Precision: 0.7195
35
+ - Athlete Recall: 0.7636
36
+ - Athlete F1: 0.7409
37
  - Athlete Number: 719
38
+ - Carmanufacturer Precision: 0.6806
39
+ - Carmanufacturer Recall: 0.8176
40
+ - Carmanufacturer F1: 0.7429
41
  - Carmanufacturer Number: 159
42
+ - Cleric Precision: 0.6867
43
+ - Cleric Recall: 0.5124
44
+ - Cleric F1: 0.5869
45
  - Cleric Number: 201
46
+ - Clothing Precision: 0.5797
47
+ - Clothing Recall: 0.625
48
+ - Clothing F1: 0.6015
49
  - Clothing Number: 128
50
+ - Disease Precision: 0.6262
51
+ - Disease Recall: 0.6768
52
+ - Disease F1: 0.6505
53
  - Disease Number: 198
54
+ - Drink Precision: 0.7296
55
  - Drink Recall: 0.8112
56
+ - Drink F1: 0.7682
57
  - Drink Number: 143
58
+ - Facility Precision: 0.6439
59
+ - Facility Recall: 0.7203
60
+ - Facility F1: 0.6800
61
  - Facility Number: 497
62
+ - Food Precision: 0.6786
63
+ - Food Recall: 0.5327
64
+ - Food F1: 0.5969
65
  - Food Number: 214
66
+ - Humansettlement Precision: 0.8594
67
+ - Humansettlement Recall: 0.8792
68
+ - Humansettlement F1: 0.8692
69
  - Humansettlement Number: 1689
70
+ - Medicalprocedure Precision: 0.6545
71
+ - Medicalprocedure Recall: 0.7606
72
+ - Medicalprocedure F1: 0.7036
73
  - Medicalprocedure Number: 142
74
+ - Medication/vaccine Precision: 0.7183
75
+ - Medication/vaccine Recall: 0.765
76
+ - Medication/vaccine F1: 0.7409
77
  - Medication/vaccine Number: 200
78
+ - Musicalgrp Precision: 0.7132
79
+ - Musicalgrp Recall: 0.7688
80
+ - Musicalgrp F1: 0.7400
81
  - Musicalgrp Number: 372
82
+ - Musicalwork Precision: 0.7513
83
+ - Musicalwork Recall: 0.7052
84
+ - Musicalwork F1: 0.7275
85
  - Musicalwork Number: 407
86
+ - Org Precision: 0.6335
87
+ - Org Recall: 0.6117
88
+ - Org F1: 0.6224
89
  - Org Number: 667
90
+ - Otherloc Precision: 0.7514
91
+ - Otherloc Recall: 0.6205
92
+ - Otherloc F1: 0.6797
93
  - Otherloc Number: 224
94
+ - Otherper Precision: 0.4558
95
+ - Otherper Recall: 0.5821
96
+ - Otherper F1: 0.5112
97
  - Otherper Number: 859
98
+ - Otherprod Precision: 0.6076
99
+ - Otherprod Recall: 0.5543
100
+ - Otherprod F1: 0.5797
101
  - Otherprod Number: 433
102
+ - Politician Precision: 0.6228
103
+ - Politician Recall: 0.4793
104
+ - Politician F1: 0.5417
105
  - Politician Number: 603
106
+ - Privatecorp Precision: 0.7159
107
+ - Privatecorp Recall: 0.4884
108
+ - Privatecorp F1: 0.5806
109
  - Privatecorp Number: 129
110
+ - Publiccorp Precision: 0.56
111
+ - Publiccorp Recall: 0.6914
112
+ - Publiccorp F1: 0.6188
113
  - Publiccorp Number: 243
114
+ - Scientist Precision: 0.4545
115
+ - Scientist Recall: 0.4497
116
+ - Scientist F1: 0.4521
117
  - Scientist Number: 189
118
+ - Software Precision: 0.7159
119
+ - Software Recall: 0.8046
120
+ - Software F1: 0.7577
121
  - Software Number: 307
122
+ - Sportsgrp Precision: 0.7845
123
+ - Sportsgrp Recall: 0.8701
124
+ - Sportsgrp F1: 0.8251
125
  - Sportsgrp Number: 385
126
+ - Sportsmanager Precision: 0.6667
127
+ - Sportsmanager Recall: 0.5361
128
+ - Sportsmanager F1: 0.5943
129
  - Sportsmanager Number: 194
130
+ - Station Precision: 0.7406
131
  - Station Recall: 0.8093
132
+ - Station F1: 0.7734
133
  - Station Number: 194
134
+ - Symptom Precision: 0.6316
135
+ - Symptom Recall: 0.5581
136
+ - Symptom F1: 0.5926
137
  - Symptom Number: 129
138
+ - Vehicle Precision: 0.5514
139
+ - Vehicle Recall: 0.6505
140
+ - Vehicle F1: 0.5969
141
  - Vehicle Number: 206
142
+ - Visualwork Precision: 0.7538
143
+ - Visualwork Recall: 0.7951
144
+ - Visualwork F1: 0.7739
145
  - Visualwork Number: 693
146
+ - Writtenwork Precision: 0.6913
147
+ - Writtenwork Recall: 0.6803
148
+ - Writtenwork F1: 0.6858
149
  - Writtenwork Number: 563
150
+ - Overall Precision: 0.6928
151
+ - Overall Recall: 0.7142
152
+ - Overall F1: 0.7033
153
+ - Overall Accuracy: 0.9355
154
 
155
  ## Model description
156