Hugging Face's logo

veronica-girolimetti
/
t5-dialogue-classification

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
veronica-girolimetti commited on
Commit
054ef83
•
1 Parent(s): 5504011

End of training

Browse files
Files changed (4) hide show
  1. README.md +218 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Jan07_14-08-24_964ad80d88b3/events.out.tfevents.1704636512.964ad80d88b3.287.0 +2 -2
README.md ADDED
@@ -0,0 +1,218 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: t5-dialogue-classification
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # t5-dialogue-classification
15
+
16
+ This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.2827
19
+ - Classification Report: precision recall f1-score support
20
+
21
+ ALLERGY 1.00 0.92 0.96 12
22
+ ASSESSMENT 0.14 0.09 0.11 11
23
+ CC 0.35 0.55 0.43 11
24
+ DIAGNOSIS 0.00 0.00 0.00 1
25
+ DISPOSITION 1.00 1.00 1.00 1
26
+ EDCOURSE 0.00 0.00 0.00 4
27
+ EXAM 0.40 0.40 0.40 5
28
+ FAM/SOCHX 0.88 0.96 0.91 45
29
+ GENHX 0.77 0.83 0.80 53
30
+ GYNHX 0.00 0.00 0.00 1
31
+ IMAGING 0.00 0.00 0.00 1
32
+ IMMUNIZATIONS 0.00 0.00 0.00 1
33
+ LABS 0.00 0.00 0.00 1
34
+ MEDICATIONS 0.83 1.00 0.91 10
35
+ OTHER_HISTORY 0.00 0.00 0.00 3
36
+ PASTMEDICALHX 0.58 0.79 0.67 14
37
+ PASTSURGICAL 1.00 0.86 0.92 7
38
+ PLAN 0.00 0.00 0.00 1
39
+ PROCEDURES 0.00 0.00 0.00 1
40
+ ROS 0.85 0.65 0.73 17
41
+
42
+ accuracy 0.73 200
43
+ macro avg 0.39 0.40 0.39 200
44
+ weighted avg 0.69 0.73 0.71 200
45
+
46
+
47
+ ## Model description
48
+
49
+ More information needed
50
+
51
+ ## Intended uses & limitations
52
+
53
+ More information needed
54
+
55
+ ## Training and evaluation data
56
+
57
+ More information needed
58
+
59
+ ## Training procedure
60
+
61
+ ### Training hyperparameters
62
+
63
+ The following hyperparameters were used during training:
64
+ - learning_rate: 0.0003
65
+ - train_batch_size: 8
66
+ - eval_batch_size: 4
67
+ - seed: 42
68
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
69
+ - lr_scheduler_type: linear
70
+ - num_epochs: 5
71
+
72
+ ### Training results
73
+
74
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | No log | 1.0 | 163 | 0.3372 | precision recall f1-score support
77
+
78
+ ALLERGY 1.00 0.92 0.96 12
79
+ ASSESSMENT 0.00 0.00 0.00 11
80
+ CC 0.20 0.09 0.13 11
81
+ DIAGNOSIS 0.00 0.00 0.00 1
82
+ DISPOSITION 0.00 0.00 0.00 1
83
+ EDCOURSE 0.00 0.00 0.00 4
84
+ EXAM 0.50 0.20 0.29 5
85
+ FAM/SOCHX 0.90 0.96 0.92 45
86
+ GENHX 0.63 0.77 0.69 53
87
+ GYNHX 0.00 0.00 0.00 1
88
+ IMAGING 0.00 0.00 0.00 1
89
+ IMMUNIZATIONS 0.00 0.00 0.00 1
90
+ LABS 0.00 0.00 0.00 1
91
+ MEDICATIONS 0.83 1.00 0.91 10
92
+ OTHER_HISTORY 0.00 0.00 0.00 3
93
+ PASTMEDICALHX 0.31 0.64 0.42 14
94
+ PASTSURGICAL 0.78 1.00 0.88 7
95
+ PLAN 0.00 0.00 0.00 1
96
+ PROCEDURES 0.00 0.00 0.00 1
97
+ ROS 0.75 0.35 0.48 17
98
+
99
+ accuracy 0.65 200
100
+ macro avg 0.29 0.30 0.28 200
101
+ weighted avg 0.61 0.65 0.61 200
102
+ |
103
+ | No log | 2.0 | 326 | 0.2335 | precision recall f1-score support
104
+
105
+ ALLERGY 1.00 0.92 0.96 12
106
+ ASSESSMENT 0.00 0.00 0.00 11
107
+ CC 0.26 0.55 0.35 11
108
+ DIAGNOSIS 0.00 0.00 0.00 1
109
+ DISPOSITION 0.00 0.00 0.00 1
110
+ EDCOURSE 0.00 0.00 0.00 4
111
+ EXAM 0.67 0.40 0.50 5
112
+ FAM/SOCHX 0.88 0.96 0.91 45
113
+ GENHX 0.79 0.87 0.83 53
114
+ GYNHX 0.00 0.00 0.00 1
115
+ IMAGING 0.00 0.00 0.00 1
116
+ IMMUNIZATIONS 0.00 0.00 0.00 1
117
+ LABS 0.00 0.00 0.00 1
118
+ MEDICATIONS 0.83 1.00 0.91 10
119
+ OTHER_HISTORY 0.00 0.00 0.00 3
120
+ PASTMEDICALHX 0.46 0.79 0.58 14
121
+ PASTSURGICAL 1.00 0.86 0.92 7
122
+ PLAN 0.00 0.00 0.00 1
123
+ PROCEDURES 0.00 0.00 0.00 1
124
+ ROS 0.83 0.59 0.69 17
125
+
126
+ accuracy 0.73 200
127
+ macro avg 0.34 0.35 0.33 200
128
+ weighted avg 0.68 0.72 0.69 200
129
+ |
130
+ | No log | 3.0 | 489 | 0.2770 | precision recall f1-score support
131
+
132
+ ALLERGY 1.00 0.92 0.96 12
133
+ ASSESSMENT 0.00 0.00 0.00 11
134
+ CC 0.26 0.45 0.33 11
135
+ DIAGNOSIS 0.00 0.00 0.00 1
136
+ DISPOSITION 0.00 0.00 0.00 1
137
+ EDCOURSE 0.00 0.00 0.00 4
138
+ EXAM 0.50 0.40 0.44 5
139
+ FAM/SOCHX 0.88 0.96 0.91 45
140
+ GENHX 0.75 0.85 0.80 53
141
+ GYNHX 0.00 0.00 0.00 1
142
+ IMAGING 0.00 0.00 0.00 1
143
+ IMMUNIZATIONS 0.00 0.00 0.00 1
144
+ LABS 0.00 0.00 0.00 1
145
+ MEDICATIONS 0.83 1.00 0.91 10
146
+ OTHER_HISTORY 0.00 0.00 0.00 3
147
+ PASTMEDICALHX 0.43 0.64 0.51 14
148
+ PASTSURGICAL 0.78 1.00 0.88 7
149
+ PLAN 0.00 0.00 0.00 1
150
+ PROCEDURES 0.00 0.00 0.00 1
151
+ ROS 0.79 0.65 0.71 17
152
+
153
+ accuracy 0.71 200
154
+ macro avg 0.31 0.34 0.32 200
155
+ weighted avg 0.65 0.71 0.68 200
156
+ |
157
+ | 0.3713 | 4.0 | 652 | 0.2746 | precision recall f1-score support
158
+
159
+ ALLERGY 1.00 0.92 0.96 12
160
+ ASSESSMENT 0.11 0.09 0.10 11
161
+ CC 0.35 0.55 0.43 11
162
+ DIAGNOSIS 0.00 0.00 0.00 1
163
+ DISPOSITION 1.00 1.00 1.00 1
164
+ EDCOURSE 0.00 0.00 0.00 4
165
+ EXAM 0.25 0.20 0.22 5
166
+ FAM/SOCHX 0.88 0.93 0.90 45
167
+ GENHX 0.86 0.83 0.85 53
168
+ GYNHX 0.00 0.00 0.00 1
169
+ IMAGING 0.00 0.00 0.00 1
170
+ IMMUNIZATIONS 0.00 0.00 0.00 1
171
+ LABS 0.00 0.00 0.00 1
172
+ MEDICATIONS 0.83 1.00 0.91 10
173
+ OTHER_HISTORY 0.00 0.00 0.00 3
174
+ PASTMEDICALHX 0.52 0.79 0.63 14
175
+ PASTSURGICAL 1.00 1.00 1.00 7
176
+ PLAN 0.00 0.00 0.00 1
177
+ PROCEDURES 0.00 0.00 0.00 1
178
+ ROS 0.86 0.71 0.77 17
179
+
180
+ accuracy 0.73 200
181
+ macro avg 0.38 0.40 0.39 200
182
+ weighted avg 0.71 0.73 0.71 200
183
+ |
184
+ | 0.3713 | 5.0 | 815 | 0.2827 | precision recall f1-score support
185
+
186
+ ALLERGY 1.00 0.92 0.96 12
187
+ ASSESSMENT 0.14 0.09 0.11 11
188
+ CC 0.35 0.55 0.43 11
189
+ DIAGNOSIS 0.00 0.00 0.00 1
190
+ DISPOSITION 1.00 1.00 1.00 1
191
+ EDCOURSE 0.00 0.00 0.00 4
192
+ EXAM 0.40 0.40 0.40 5
193
+ FAM/SOCHX 0.88 0.96 0.91 45
194
+ GENHX 0.77 0.83 0.80 53
195
+ GYNHX 0.00 0.00 0.00 1
196
+ IMAGING 0.00 0.00 0.00 1
197
+ IMMUNIZATIONS 0.00 0.00 0.00 1
198
+ LABS 0.00 0.00 0.00 1
199
+ MEDICATIONS 0.83 1.00 0.91 10
200
+ OTHER_HISTORY 0.00 0.00 0.00 3
201
+ PASTMEDICALHX 0.58 0.79 0.67 14
202
+ PASTSURGICAL 1.00 0.86 0.92 7
203
+ PLAN 0.00 0.00 0.00 1
204
+ PROCEDURES 0.00 0.00 0.00 1
205
+ ROS 0.85 0.65 0.73 17
206
+
207
+ accuracy 0.73 200
208
+ macro avg 0.39 0.40 0.39 200
209
+ weighted avg 0.69 0.73 0.71 200
210
+ |
211
+
212
+
213
+ ### Framework versions
214
+
215
+ - Transformers 4.35.2
216
+ - Pytorch 2.1.0+cu121
217
+ - Datasets 2.16.1
218
+ - Tokenizers 0.15.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0cdf973cd35547b6a726d02e0c7eefa85a6a9504ddc1fe77251ddb2ac9134283
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4571dba3ba65469458420488f9b51fb35f2c9b1c753a5c716ec4ca105f83dd7f
3
  size 307867048
runs/Jan07_14-08-24_964ad80d88b3/events.out.tfevents.1704636512.964ad80d88b3.287.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f753afe70d1e1ecf1278d030f644334a31854a959b3654b58e92a8bbdd6d0a21
3
- size 6245
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb42e291f1644f215b33e87df120dacf77ed59c20d91f44f8f01e7ee81915ac8
3
+ size 7141