nogae commited on
Commit
ac9ec37
1 Parent(s): 6d59b5e

End of training

Browse files
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ base_model: sileod/deberta-v3-base-tasksource-nli
6
+ tags:
7
+ - generated_from_trainer
8
+ metrics:
9
+ - accuracy
10
+ - precision
11
+ - recall
12
+ - f1
13
+ model-index:
14
+ - name: results
15
+ results: []
16
+ ---
17
+
18
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
19
+ should probably proofread and complete it, then remove this comment. -->
20
+
21
+ # results
22
+
23
+ This model is a fine-tuned version of [sileod/deberta-v3-base-tasksource-nli](https://huggingface.co/sileod/deberta-v3-base-tasksource-nli) on an unknown dataset.
24
+ It achieves the following results on the evaluation set:
25
+ - Loss: 0.0000
26
+ - Accuracy: 1.0
27
+ - Precision: 1.0
28
+ - Recall: 1.0
29
+ - F1: 1.0
30
+
31
+ ## Model description
32
+
33
+ More information needed
34
+
35
+ ## Intended uses & limitations
36
+
37
+ More information needed
38
+
39
+ ## Training and evaluation data
40
+
41
+ More information needed
42
+
43
+ ## Training procedure
44
+
45
+ ### Training hyperparameters
46
+
47
+ The following hyperparameters were used during training:
48
+ - learning_rate: 5e-05
49
+ - train_batch_size: 8
50
+ - eval_batch_size: 8
51
+ - seed: 0
52
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
+ - lr_scheduler_type: linear
54
+ - num_epochs: 3
55
+
56
+ ### Training results
57
+
58
+
59
+
60
+ ### Framework versions
61
+
62
+ - Transformers 4.38.2
63
+ - Pytorch 2.1.1
64
+ - Datasets 2.15.0
65
+ - Tokenizers 0.15.2
all_results.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_Accuracy": 1.0,
4
+ "eval_F1": 1.0,
5
+ "eval_Precision": 1.0,
6
+ "eval_Recall": 1.0,
7
+ "eval_loss": 1.5955849448801018e-05,
8
+ "eval_runtime": 1.5082,
9
+ "eval_samples_per_second": 100.784,
10
+ "eval_steps_per_second": 12.598
11
+ }
config.json ADDED
@@ -0,0 +1,1059 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "sileod/deberta-v3-base-tasksource-nli",
3
+ "architectures": [
4
+ "DebertaV2ForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifiers_size": [
8
+ 3,
9
+ 2,
10
+ 2,
11
+ 2,
12
+ 2,
13
+ 2,
14
+ 1,
15
+ 2,
16
+ 3,
17
+ 2,
18
+ 2,
19
+ 2,
20
+ 3,
21
+ 3,
22
+ 3,
23
+ 3,
24
+ 1,
25
+ 3,
26
+ 3,
27
+ 2,
28
+ 2,
29
+ 3,
30
+ 2,
31
+ 6,
32
+ 2,
33
+ 2,
34
+ 2,
35
+ 2,
36
+ 2,
37
+ 2,
38
+ 2,
39
+ 2,
40
+ 2,
41
+ 3,
42
+ 3,
43
+ 3,
44
+ 3,
45
+ 3,
46
+ 3,
47
+ 3,
48
+ 2,
49
+ 2,
50
+ 2,
51
+ 2,
52
+ 5,
53
+ 3,
54
+ 3,
55
+ 3,
56
+ 3,
57
+ 3,
58
+ 3,
59
+ 3,
60
+ 3,
61
+ 2,
62
+ 2,
63
+ 2,
64
+ 3,
65
+ 3,
66
+ 3,
67
+ 3,
68
+ 3,
69
+ 3,
70
+ 3,
71
+ 3,
72
+ 2,
73
+ 2,
74
+ 2,
75
+ 2,
76
+ 47,
77
+ 23,
78
+ 9,
79
+ 1,
80
+ 1,
81
+ 1,
82
+ 1,
83
+ 1,
84
+ 1,
85
+ 1,
86
+ 1,
87
+ 1,
88
+ 1,
89
+ 1,
90
+ 1,
91
+ 1,
92
+ 1,
93
+ 1,
94
+ 1,
95
+ 1,
96
+ 1,
97
+ 1,
98
+ 1,
99
+ 1,
100
+ 1,
101
+ 1,
102
+ 1,
103
+ 1,
104
+ 1,
105
+ 1,
106
+ 1,
107
+ 1,
108
+ 1,
109
+ 1,
110
+ 1,
111
+ 1,
112
+ 1,
113
+ 1,
114
+ 1,
115
+ 1,
116
+ 1,
117
+ 1,
118
+ 1,
119
+ 1,
120
+ 1,
121
+ 1,
122
+ 1,
123
+ 1,
124
+ 1,
125
+ 1,
126
+ 1,
127
+ 1,
128
+ 1,
129
+ 1,
130
+ 1,
131
+ 1,
132
+ 1,
133
+ 1,
134
+ 1,
135
+ 1,
136
+ 1,
137
+ 1,
138
+ 1,
139
+ 1,
140
+ 1,
141
+ 1,
142
+ 1,
143
+ 1,
144
+ 1,
145
+ 1,
146
+ 1,
147
+ 1,
148
+ 1,
149
+ 1,
150
+ 1,
151
+ 1,
152
+ 1,
153
+ 1,
154
+ 1,
155
+ 1,
156
+ 1,
157
+ 1,
158
+ 1,
159
+ 1,
160
+ 1,
161
+ 1,
162
+ 1,
163
+ 1,
164
+ 1,
165
+ 1,
166
+ 1,
167
+ 1,
168
+ 1,
169
+ 1,
170
+ 1,
171
+ 1,
172
+ 1,
173
+ 1,
174
+ 1,
175
+ 1,
176
+ 1,
177
+ 1,
178
+ 1,
179
+ 1,
180
+ 1,
181
+ 1,
182
+ 1,
183
+ 1,
184
+ 1,
185
+ 1,
186
+ 1,
187
+ 1,
188
+ 1,
189
+ 1,
190
+ 1,
191
+ 1,
192
+ 1,
193
+ 1,
194
+ 1,
195
+ 1,
196
+ 1,
197
+ 1,
198
+ 1,
199
+ 1,
200
+ 1,
201
+ 1,
202
+ 1,
203
+ 1,
204
+ 1,
205
+ 1,
206
+ 1,
207
+ 1,
208
+ 2,
209
+ 2,
210
+ 2,
211
+ 2,
212
+ 2,
213
+ 2,
214
+ 20,
215
+ 50,
216
+ 3,
217
+ 3,
218
+ 4,
219
+ 2,
220
+ 8,
221
+ 3,
222
+ 2,
223
+ 2,
224
+ 2,
225
+ 4,
226
+ 20,
227
+ 3,
228
+ 3,
229
+ 3,
230
+ 3,
231
+ 3,
232
+ 174,
233
+ 2,
234
+ 2,
235
+ 41,
236
+ 2,
237
+ 2,
238
+ 51,
239
+ 2,
240
+ 3,
241
+ 2,
242
+ 2,
243
+ 2,
244
+ 3,
245
+ 16,
246
+ 2,
247
+ 18,
248
+ 8,
249
+ 2,
250
+ 17,
251
+ 3,
252
+ 2,
253
+ 4,
254
+ 7,
255
+ 12,
256
+ 7,
257
+ 3,
258
+ 3,
259
+ 42,
260
+ 11,
261
+ 100,
262
+ 13,
263
+ 100,
264
+ 8,
265
+ 1,
266
+ 20,
267
+ 2,
268
+ 2,
269
+ 4,
270
+ 5,
271
+ 3,
272
+ 4,
273
+ 14,
274
+ 2,
275
+ 6,
276
+ 4,
277
+ 2,
278
+ 1,
279
+ 3,
280
+ 10,
281
+ 3,
282
+ 10,
283
+ 4,
284
+ 2,
285
+ 7,
286
+ 6,
287
+ 28,
288
+ 3,
289
+ 6,
290
+ 3,
291
+ 6,
292
+ 5,
293
+ 7,
294
+ 4,
295
+ 2,
296
+ 2,
297
+ 2,
298
+ 6,
299
+ 2,
300
+ 2,
301
+ 7,
302
+ 20,
303
+ 2,
304
+ 9,
305
+ 2,
306
+ 3,
307
+ 13,
308
+ 2,
309
+ 3,
310
+ 2,
311
+ 4,
312
+ 4,
313
+ 2,
314
+ 2,
315
+ 2,
316
+ 2,
317
+ 4,
318
+ 1,
319
+ 2,
320
+ 1,
321
+ 13,
322
+ 3,
323
+ 5,
324
+ 11,
325
+ 37,
326
+ 2,
327
+ 49,
328
+ 40,
329
+ 10,
330
+ 4,
331
+ 1,
332
+ 2,
333
+ 2,
334
+ 1,
335
+ 5,
336
+ 2,
337
+ 3,
338
+ 2,
339
+ 2,
340
+ 12,
341
+ 3,
342
+ 3,
343
+ 2,
344
+ 19,
345
+ 3,
346
+ 1,
347
+ 2,
348
+ 2,
349
+ 2,
350
+ 2,
351
+ 2,
352
+ 1,
353
+ 2,
354
+ 2,
355
+ 1,
356
+ 1,
357
+ 2,
358
+ 3,
359
+ 2,
360
+ 1,
361
+ 4,
362
+ 3,
363
+ 1,
364
+ 1,
365
+ 1,
366
+ 2,
367
+ 3,
368
+ 2,
369
+ 3,
370
+ 1,
371
+ 1,
372
+ 2,
373
+ 1,
374
+ 3,
375
+ 2,
376
+ 2,
377
+ 2,
378
+ 2,
379
+ 2,
380
+ 3,
381
+ 2,
382
+ 2,
383
+ 2,
384
+ 1,
385
+ 3,
386
+ 2,
387
+ 2,
388
+ 1,
389
+ 1,
390
+ 1,
391
+ 1,
392
+ 2,
393
+ 1,
394
+ 1,
395
+ 1,
396
+ 1,
397
+ 4,
398
+ 1,
399
+ 1,
400
+ 1,
401
+ 1,
402
+ 3,
403
+ 1,
404
+ 3,
405
+ 1,
406
+ 2,
407
+ 2,
408
+ 1,
409
+ 2,
410
+ 3,
411
+ 3,
412
+ 2,
413
+ 1,
414
+ 3,
415
+ 1,
416
+ 1,
417
+ 3,
418
+ 1,
419
+ 3,
420
+ 2,
421
+ 1,
422
+ 1,
423
+ 1,
424
+ 2,
425
+ 2,
426
+ 50,
427
+ 50,
428
+ 50,
429
+ 50,
430
+ 2,
431
+ 1,
432
+ 1,
433
+ 1,
434
+ 1,
435
+ 1,
436
+ 1,
437
+ 1,
438
+ 1,
439
+ 1,
440
+ 1,
441
+ 1,
442
+ 2,
443
+ 2,
444
+ 2,
445
+ 2,
446
+ 77,
447
+ 2,
448
+ 1,
449
+ 3,
450
+ 2,
451
+ 2,
452
+ 1,
453
+ 1,
454
+ 2,
455
+ 2,
456
+ 2,
457
+ 2,
458
+ 2,
459
+ 2,
460
+ 2,
461
+ 2,
462
+ 2,
463
+ 3,
464
+ 18,
465
+ 13,
466
+ 2,
467
+ 2,
468
+ 2,
469
+ 2,
470
+ 2,
471
+ 2,
472
+ 4,
473
+ 2,
474
+ 24,
475
+ 23,
476
+ 67,
477
+ 279,
478
+ 3,
479
+ 2,
480
+ 2,
481
+ 1,
482
+ 2,
483
+ 2,
484
+ 3,
485
+ 1,
486
+ 2,
487
+ 3,
488
+ 2,
489
+ 3,
490
+ 3,
491
+ 2,
492
+ 2,
493
+ 4,
494
+ 1,
495
+ 17,
496
+ 3,
497
+ 2,
498
+ 3,
499
+ 2,
500
+ 3,
501
+ 3,
502
+ 2,
503
+ 1,
504
+ 1,
505
+ 3,
506
+ 2,
507
+ 2,
508
+ 3,
509
+ 3,
510
+ 3,
511
+ 1,
512
+ 1
513
+ ],
514
+ "hidden_act": "gelu",
515
+ "hidden_dropout_prob": 0.1,
516
+ "hidden_size": 768,
517
+ "id2label": {
518
+ "0": "multi",
519
+ "1": "simple",
520
+ "2": "compare"
521
+ },
522
+ "initializer_range": 0.02,
523
+ "intermediate_size": 3072,
524
+ "label2id": {
525
+ "compare": 2,
526
+ "multi": 0,
527
+ "simple": 1
528
+ },
529
+ "layer_norm_eps": 1e-07,
530
+ "max_position_embeddings": 512,
531
+ "max_relative_positions": -1,
532
+ "model_type": "deberta-v2",
533
+ "norm_rel_ebd": "layer_norm",
534
+ "num_attention_heads": 12,
535
+ "num_hidden_layers": 12,
536
+ "pad_token_id": 0,
537
+ "pooler_dropout": 0,
538
+ "pooler_hidden_act": "gelu",
539
+ "pooler_hidden_size": 768,
540
+ "pos_att_type": [
541
+ "p2c",
542
+ "c2p"
543
+ ],
544
+ "position_biased_input": false,
545
+ "position_buckets": 256,
546
+ "relative_attention": true,
547
+ "share_att_key": true,
548
+ "tasks": [
549
+ "glue/mnli",
550
+ "glue/qnli",
551
+ "glue/rte",
552
+ "glue/wnli",
553
+ "glue/mrpc",
554
+ "glue/qqp",
555
+ "glue/stsb",
556
+ "super_glue/boolq",
557
+ "super_glue/cb",
558
+ "super_glue/multirc",
559
+ "super_glue/wic",
560
+ "super_glue/axg",
561
+ "anli/a1",
562
+ "anli/a2",
563
+ "anli/a3",
564
+ "sick/label",
565
+ "sick/relatedness",
566
+ "sick/entailment_AB",
567
+ "snli",
568
+ "scitail/snli_format",
569
+ "hans",
570
+ "WANLI",
571
+ "recast/recast_verbnet",
572
+ "recast/recast_kg_relations",
573
+ "recast/recast_ner",
574
+ "recast/recast_factuality",
575
+ "recast/recast_puns",
576
+ "recast/recast_megaveridicality",
577
+ "recast/recast_sentiment",
578
+ "recast/recast_verbcorner",
579
+ "probability_words_nli/usnli",
580
+ "probability_words_nli/reasoning_1hop",
581
+ "probability_words_nli/reasoning_2hop",
582
+ "nan-nli/joey234--nan-nli",
583
+ "nli_fever",
584
+ "breaking_nli",
585
+ "conj_nli",
586
+ "fracas",
587
+ "dialogue_nli",
588
+ "mpe",
589
+ "dnc",
590
+ "recast_white/fnplus",
591
+ "recast_white/sprl",
592
+ "recast_white/dpr",
593
+ "joci",
594
+ "robust_nli/IS_CS",
595
+ "robust_nli/LI_LI",
596
+ "robust_nli/ST_WO",
597
+ "robust_nli/PI_SP",
598
+ "robust_nli/PI_CD",
599
+ "robust_nli/ST_SE",
600
+ "robust_nli/ST_NE",
601
+ "robust_nli/ST_LM",
602
+ "robust_nli_is_sd",
603
+ "robust_nli_li_ts",
604
+ "add_one_rte",
605
+ "imppres/implicature_numerals_10_100/log",
606
+ "imppres/implicature_connectives/log",
607
+ "imppres/implicature_modals/log",
608
+ "imppres/implicature_gradable_verb/log",
609
+ "imppres/implicature_gradable_adjective/log",
610
+ "imppres/implicature_numerals_2_3/log",
611
+ "imppres/implicature_quantifiers/log",
612
+ "glue_diagnostics/diagnostics",
613
+ "hlgd",
614
+ "paws/labeled_final",
615
+ "paws/labeled_swap",
616
+ "medical_questions_pairs",
617
+ "conll2003/pos_tags",
618
+ "conll2003/chunk_tags",
619
+ "conll2003/ner_tags",
620
+ "hh-rlhf",
621
+ "model-written-evals",
622
+ "truthful_qa/multiple_choice",
623
+ "fig-qa",
624
+ "bigbench/physical_intuition",
625
+ "bigbench/authorship_verification",
626
+ "bigbench/implicit_relations",
627
+ "bigbench/dyck_languages",
628
+ "bigbench/novel_concepts",
629
+ "bigbench/moral_permissibility",
630
+ "bigbench/metaphor_understanding",
631
+ "bigbench/temporal_sequences",
632
+ "bigbench/sports_understanding",
633
+ "bigbench/analytic_entailment",
634
+ "bigbench/social_support",
635
+ "bigbench/emoji_movie",
636
+ "bigbench/dark_humor_detection",
637
+ "bigbench/suicide_risk",
638
+ "bigbench/fact_checker",
639
+ "bigbench/hhh_alignment",
640
+ "bigbench/formal_fallacies_syllogisms_negation",
641
+ "bigbench/bbq_lite_json",
642
+ "bigbench/cause_and_effect",
643
+ "bigbench/logic_grid_puzzle",
644
+ "bigbench/empirical_judgments",
645
+ "bigbench/human_organs_senses",
646
+ "bigbench/misconceptions",
647
+ "bigbench/strange_stories",
648
+ "bigbench/logical_args",
649
+ "bigbench/known_unknowns",
650
+ "bigbench/cs_algorithms",
651
+ "bigbench/emojis_emotion_prediction",
652
+ "bigbench/cifar10_classification",
653
+ "bigbench/penguins_in_a_table",
654
+ "bigbench/odd_one_out",
655
+ "bigbench/intent_recognition",
656
+ "bigbench/physics",
657
+ "bigbench/conceptual_combinations",
658
+ "bigbench/logical_deduction",
659
+ "bigbench/causal_judgment",
660
+ "bigbench/winowhy",
661
+ "bigbench/arithmetic",
662
+ "bigbench/undo_permutation",
663
+ "bigbench/analogical_similarity",
664
+ "bigbench/social_iqa",
665
+ "bigbench/key_value_maps",
666
+ "bigbench/implicatures",
667
+ "bigbench/real_or_fake_text",
668
+ "bigbench/disambiguation_qa",
669
+ "bigbench/similarities_abstraction",
670
+ "bigbench/movie_dialog_same_or_different",
671
+ "bigbench/english_proverbs",
672
+ "bigbench/presuppositions_as_nli",
673
+ "bigbench/entailed_polarity",
674
+ "bigbench/snarks",
675
+ "bigbench/goal_step_wikihow",
676
+ "bigbench/crass_ai",
677
+ "bigbench/play_dialog_same_or_different",
678
+ "bigbench/hindu_knowledge",
679
+ "bigbench/international_phonetic_alphabet_nli",
680
+ "bigbench/understanding_fables",
681
+ "bigbench/geometric_shapes",
682
+ "bigbench/code_line_description",
683
+ "bigbench/riddle_sense",
684
+ "bigbench/symbol_interpretation",
685
+ "bigbench/irony_identification",
686
+ "bigbench/anachronisms",
687
+ "bigbench/navigate",
688
+ "bigbench/crash_blossom",
689
+ "bigbench/identify_odd_metaphor",
690
+ "bigbench/simple_ethical_questions",
691
+ "bigbench/contextual_parametric_knowledge_conflicts",
692
+ "bigbench/date_understanding",
693
+ "bigbench/figure_of_speech_detection",
694
+ "bigbench/question_selection",
695
+ "bigbench/elementary_math_qa",
696
+ "bigbench/nonsense_words_grammar",
697
+ "bigbench/salient_translation_error_detection",
698
+ "bigbench/epistemic_reasoning",
699
+ "bigbench/movie_recommendation",
700
+ "bigbench/strategyqa",
701
+ "bigbench/tracking_shuffled_objects",
702
+ "bigbench/unit_interpretation",
703
+ "bigbench/reasoning_about_colored_objects",
704
+ "bigbench/discourse_marker_prediction",
705
+ "bigbench/logical_fallacy_detection",
706
+ "bigbench/general_knowledge",
707
+ "bigbench/abstract_narrative_understanding",
708
+ "bigbench/color",
709
+ "bigbench/hyperbaton",
710
+ "bigbench/logical_sequence",
711
+ "bigbench/mnist_ascii",
712
+ "bigbench/fantasy_reasoning",
713
+ "bigbench/mathematical_induction",
714
+ "bigbench/timedial",
715
+ "bigbench/identify_math_theorems",
716
+ "bigbench/checkmate_in_one",
717
+ "bigbench/phrase_relatedness",
718
+ "bigbench/ruin_names",
719
+ "bigbench/gre_reading_comprehension",
720
+ "bigbench/metaphor_boolean",
721
+ "bigbench/sentence_ambiguity",
722
+ "bigbench/vitaminc_fact_verification",
723
+ "bigbench/evaluating_information_essentiality",
724
+ "cos_e/v1.0",
725
+ "cosmos_qa",
726
+ "dream",
727
+ "openbookqa",
728
+ "qasc",
729
+ "quartz",
730
+ "quail",
731
+ "head_qa/en",
732
+ "sciq",
733
+ "social_i_qa",
734
+ "wiki_hop/original",
735
+ "wiqa",
736
+ "piqa",
737
+ "hellaswag",
738
+ "super_glue/copa",
739
+ "balanced-copa",
740
+ "e-CARE",
741
+ "art",
742
+ "winogrande/winogrande_xl",
743
+ "codah/codah",
744
+ "ai2_arc/ARC-Challenge/challenge",
745
+ "ai2_arc/ARC-Easy/challenge",
746
+ "definite_pronoun_resolution",
747
+ "swag/regular",
748
+ "math_qa",
749
+ "glue/cola",
750
+ "glue/sst2",
751
+ "utilitarianism",
752
+ "amazon_counterfactual/en",
753
+ "insincere-questions",
754
+ "toxic_conversations",
755
+ "TuringBench",
756
+ "trec",
757
+ "vitaminc/tals--vitaminc",
758
+ "hope_edi/english",
759
+ "rumoureval_2019/RumourEval2019",
760
+ "ethos/binary",
761
+ "ethos/multilabel",
762
+ "tweet_eval/sentiment",
763
+ "tweet_eval/irony",
764
+ "tweet_eval/offensive",
765
+ "tweet_eval/hate",
766
+ "tweet_eval/emotion",
767
+ "tweet_eval/emoji",
768
+ "tweet_eval/stance_abortion",
769
+ "tweet_eval/stance_atheism",
770
+ "tweet_eval/stance_climate",
771
+ "tweet_eval/stance_feminist",
772
+ "tweet_eval/stance_hillary",
773
+ "discovery/discovery",
774
+ "pragmeval/squinky-informativeness",
775
+ "pragmeval/emobank-arousal",
776
+ "pragmeval/switchboard",
777
+ "pragmeval/squinky-implicature",
778
+ "pragmeval/emobank-valence",
779
+ "pragmeval/mrda",
780
+ "pragmeval/squinky-formality",
781
+ "pragmeval/verifiability",
782
+ "pragmeval/emobank-dominance",
783
+ "pragmeval/persuasiveness-specificity",
784
+ "pragmeval/persuasiveness-strength",
785
+ "pragmeval/persuasiveness-claimtype",
786
+ "pragmeval/pdtb",
787
+ "pragmeval/sarcasm",
788
+ "pragmeval/stac",
789
+ "pragmeval/persuasiveness-premisetype",
790
+ "pragmeval/persuasiveness-eloquence",
791
+ "pragmeval/gum",
792
+ "pragmeval/emergent",
793
+ "pragmeval/persuasiveness-relevance",
794
+ "silicone/dyda_da",
795
+ "silicone/dyda_e",
796
+ "silicone/maptask",
797
+ "silicone/meld_e",
798
+ "silicone/meld_s",
799
+ "silicone/sem",
800
+ "silicone/oasis",
801
+ "silicone/iemocap",
802
+ "lex_glue/eurlex",
803
+ "lex_glue/scotus",
804
+ "lex_glue/ledgar",
805
+ "lex_glue/unfair_tos",
806
+ "lex_glue/case_hold",
807
+ "language-identification",
808
+ "imdb",
809
+ "rotten_tomatoes",
810
+ "ag_news",
811
+ "yelp_review_full/yelp_review_full",
812
+ "financial_phrasebank/sentences_allagree",
813
+ "poem_sentiment",
814
+ "dbpedia_14/dbpedia_14",
815
+ "amazon_polarity/amazon_polarity",
816
+ "app_reviews",
817
+ "hate_speech18",
818
+ "sms_spam",
819
+ "humicroedit/subtask-1",
820
+ "humicroedit/subtask-2",
821
+ "snips_built_in_intents",
822
+ "hate_speech_offensive",
823
+ "yahoo_answers_topics",
824
+ "stackoverflow-questions",
825
+ "hyperpartisan_news",
826
+ "sciie",
827
+ "citation_intent",
828
+ "go_emotions/simplified",
829
+ "scicite",
830
+ "liar",
831
+ "lexical_relation_classification/ROOT09",
832
+ "lexical_relation_classification/BLESS",
833
+ "lexical_relation_classification/CogALexV",
834
+ "lexical_relation_classification/EVALution",
835
+ "lexical_relation_classification/K&H+N",
836
+ "linguisticprobing/coordination_inversion",
837
+ "linguisticprobing/obj_number",
838
+ "linguisticprobing/past_present",
839
+ "linguisticprobing/sentence_length",
840
+ "linguisticprobing/subj_number",
841
+ "linguisticprobing/odd_man_out",
842
+ "linguisticprobing/tree_depth",
843
+ "linguisticprobing/top_constituents",
844
+ "linguisticprobing/bigram_shift",
845
+ "crowdflower/political-media-message",
846
+ "crowdflower/political-media-audience",
847
+ "crowdflower/economic-news",
848
+ "crowdflower/text_emotion",
849
+ "crowdflower/political-media-bias",
850
+ "crowdflower/airline-sentiment",
851
+ "crowdflower/tweet_global_warming",
852
+ "crowdflower/corporate-messaging",
853
+ "crowdflower/sentiment_nuclear_power",
854
+ "ethics/commonsense",
855
+ "ethics/deontology",
856
+ "ethics/justice",
857
+ "ethics/virtue",
858
+ "emo/emo2019",
859
+ "google_wellformed_query",
860
+ "tweets_hate_speech_detection",
861
+ "has_part",
862
+ "wnut_17/wnut_17",
863
+ "ncbi_disease/ncbi_disease",
864
+ "acronym_identification",
865
+ "jnlpba/jnlpba",
866
+ "ontonotes_english/SpeedOfMagic--ontonotes_english",
867
+ "blog_authorship_corpus/gender",
868
+ "blog_authorship_corpus/age",
869
+ "blog_authorship_corpus/job",
870
+ "open_question_type",
871
+ "health_fact",
872
+ "commonsense_qa",
873
+ "mc_taco",
874
+ "ade_corpus_v2/Ade_corpus_v2_classification",
875
+ "discosense",
876
+ "circa",
877
+ "phrase_similarity",
878
+ "scientific-exaggeration-detection",
879
+ "quarel",
880
+ "fever-evidence-related/mwong--fever-related",
881
+ "numer_sense",
882
+ "dynasent/dynabench.dynasent.r1.all/r1",
883
+ "dynasent/dynabench.dynasent.r2.all/r2",
884
+ "Sarcasm_News_Headline",
885
+ "sem_eval_2010_task_8",
886
+ "auditor_review/demo-org--auditor_review",
887
+ "medmcqa",
888
+ "Dynasent_Disagreement",
889
+ "Politeness_Disagreement",
890
+ "SBIC_Disagreement",
891
+ "SChem_Disagreement",
892
+ "Dilemmas_Disagreement",
893
+ "logiqa",
894
+ "wiki_qa",
895
+ "cycic_classification",
896
+ "cycic_multiplechoice",
897
+ "sts-companion",
898
+ "commonsense_qa_2.0",
899
+ "lingnli",
900
+ "monotonicity-entailment",
901
+ "arct",
902
+ "scinli",
903
+ "naturallogic",
904
+ "onestop_qa",
905
+ "moral_stories/full",
906
+ "prost",
907
+ "dynahate",
908
+ "syntactic-augmentation-nli",
909
+ "autotnli",
910
+ "CONDAQA",
911
+ "webgpt_comparisons",
912
+ "synthetic-instruct-gptj-pairwise",
913
+ "scruples",
914
+ "wouldyourather",
915
+ "attempto-nli",
916
+ "defeasible-nli/snli",
917
+ "defeasible-nli/atomic",
918
+ "help-nli",
919
+ "nli-veridicality-transitivity",
920
+ "natural-language-satisfiability",
921
+ "lonli",
922
+ "dadc-limit-nli",
923
+ "FLUTE",
924
+ "strategy-qa",
925
+ "summarize_from_feedback/comparisons",
926
+ "folio",
927
+ "tomi-nli",
928
+ "avicenna",
929
+ "SHP",
930
+ "MedQA-USMLE-4-options-hf",
931
+ "wikimedqa/medwiki",
932
+ "cicero",
933
+ "CREAK",
934
+ "mutual",
935
+ "NeQA",
936
+ "quote-repetition",
937
+ "redefine-math",
938
+ "puzzte",
939
+ "implicatures",
940
+ "race/high",
941
+ "race/middle",
942
+ "race-c",
943
+ "spartqa-yn",
944
+ "spartqa-mchoice",
945
+ "temporal-nli",
946
+ "riddle_sense",
947
+ "clcd-english",
948
+ "twentyquestions",
949
+ "reclor",
950
+ "counterfactually-augmented-imdb",
951
+ "counterfactually-augmented-snli",
952
+ "cnli",
953
+ "boolq-natural-perturbations",
954
+ "acceptability-prediction",
955
+ "equate",
956
+ "ScienceQA_text_only",
957
+ "ekar_english",
958
+ "implicit-hate-stg1",
959
+ "chaos-mnli-ambiguity",
960
+ "headline_cause/en_simple",
961
+ "logiqa-2.0-nli",
962
+ "oasst1_dense_flat/quality",
963
+ "oasst1_dense_flat/toxicity",
964
+ "oasst1_dense_flat/helpfulness",
965
+ "PARARULE-Plus",
966
+ "mindgames",
967
+ "universal_dependencies/en_lines/deprel",
968
+ "universal_dependencies/en_partut/deprel",
969
+ "universal_dependencies/en_ewt/deprel",
970
+ "universal_dependencies/en_gum/deprel",
971
+ "ambient",
972
+ "path-naturalness-prediction",
973
+ "civil_comments/toxicity",
974
+ "civil_comments/severe_toxicity",
975
+ "civil_comments/obscene",
976
+ "civil_comments/threat",
977
+ "civil_comments/insult",
978
+ "civil_comments/identity_attack",
979
+ "civil_comments/sexual_explicit",
980
+ "cloth",
981
+ "dgen",
982
+ "oasst1_pairwise_rlhf_reward",
983
+ "I2D2",
984
+ "args_me",
985
+ "Touche23-ValueEval",
986
+ "starcon",
987
+ "banking77",
988
+ "ruletaker",
989
+ "lsat_qa/all",
990
+ "ConTRoL-nli",
991
+ "tracie",
992
+ "sherliic",
993
+ "sen-making/1",
994
+ "sen-making/2",
995
+ "winowhy",
996
+ "mbib-base/cognitive-bias",
997
+ "mbib-base/fake-news",
998
+ "mbib-base/gender-bias",
999
+ "mbib-base/hate-speech",
1000
+ "mbib-base/linguistic-bias",
1001
+ "mbib-base/political-bias",
1002
+ "mbib-base/racial-bias",
1003
+ "mbib-base/text-level-bias",
1004
+ "robustLR",
1005
+ "v1/gen_train234_test2to10",
1006
+ "logical-fallacy",
1007
+ "parade",
1008
+ "cladder",
1009
+ "subjectivity",
1010
+ "MOH",
1011
+ "VUAC",
1012
+ "TroFi",
1013
+ "sharc_modified/mod",
1014
+ "conceptrules_v2",
1015
+ "disrpt/eng.dep.scidtb.rels",
1016
+ "conll2000",
1017
+ "few-nerd/supervised",
1018
+ "finer-139",
1019
+ "zero-shot-label-nli",
1020
+ "com2sense",
1021
+ "scone",
1022
+ "winodict",
1023
+ "fool-me-twice",
1024
+ "monli",
1025
+ "corr2cause",
1026
+ "lsat_qa/all",
1027
+ "apt",
1028
+ "twitter-financial-news-sentiment",
1029
+ "icl-symbol-tuning-instruct",
1030
+ "SpaceNLI",
1031
+ "propsegment/nli",
1032
+ "HatemojiBuild",
1033
+ "regset",
1034
+ "esci",
1035
+ "chatbot_arena_conversations",
1036
+ "dnd_style_intents",
1037
+ "FLD.v2",
1038
+ "SDOH-NLI",
1039
+ "scifact_entailment",
1040
+ "feasibilityQA",
1041
+ "simple_pair",
1042
+ "AdjectiveScaleProbe-nli",
1043
+ "resnli",
1044
+ "SpaRTUN",
1045
+ "ReSQ",
1046
+ "semantic_fragments_nli",
1047
+ "dataset_train_nli",
1048
+ "babi_nli",
1049
+ "gen_debiased_nli",
1050
+ "imppres/presupposition",
1051
+ "/prag",
1052
+ "blimp-2",
1053
+ "mmlu-4"
1054
+ ],
1055
+ "torch_dtype": "float32",
1056
+ "transformers_version": "4.38.2",
1057
+ "type_vocab_size": 0,
1058
+ "vocab_size": 128100
1059
+ }
eval_results.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_Accuracy": 1.0,
4
+ "eval_F1": 1.0,
5
+ "eval_Precision": 1.0,
6
+ "eval_Recall": 1.0,
7
+ "eval_loss": 1.5955849448801018e-05,
8
+ "eval_runtime": 1.5082,
9
+ "eval_samples_per_second": 100.784,
10
+ "eval_steps_per_second": 12.598
11
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f48f5602a04c6f5ab082b37234adacf7a4f365c0a1f35b854cfd1f416dae5d2
3
+ size 737722356
runs/May12_11-38-12_Nogas-MacBookPro.local/events.out.tfevents.1715503093.Nogas-MacBookPro.local.3662.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:984601a56ee235c2b3b820a97ab88bbc1e87f08bb37dba7a372548305ec4c121
3
+ size 23001
runs/May12_11-38-12_Nogas-MacBookPro.local/events.out.tfevents.1715503253.Nogas-MacBookPro.local.3662.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee747b62efb72d52a38eb54780ec12e78ed90ab239b2ae65502b713e83743813
3
+ size 1504
train_results.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_Accuracy": 1.0,
4
+ "eval_F1": 1.0,
5
+ "eval_Precision": 1.0,
6
+ "eval_Recall": 1.0,
7
+ "eval_loss": 1.6744012100389227e-05,
8
+ "eval_runtime": 1.5168,
9
+ "eval_samples_per_second": 100.214,
10
+ "eval_steps_per_second": 12.527
11
+ }
trainer_state.json ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 3.0,
5
+ "eval_steps": 500,
6
+ "global_step": 456,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 3.0,
13
+ "step": 456,
14
+ "total_flos": 131122250941500.0,
15
+ "train_loss": 0.01635488606335824,
16
+ "train_runtime": 158.3006,
17
+ "train_samples_per_second": 23.026,
18
+ "train_steps_per_second": 2.881
19
+ },
20
+ {
21
+ "epoch": 3.0,
22
+ "eval_Accuracy": 1.0,
23
+ "eval_F1": 1.0,
24
+ "eval_Precision": 1.0,
25
+ "eval_Recall": 1.0,
26
+ "eval_loss": 1.6744012100389227e-05,
27
+ "eval_runtime": 1.5175,
28
+ "eval_samples_per_second": 100.163,
29
+ "eval_steps_per_second": 12.52,
30
+ "step": 456
31
+ },
32
+ {
33
+ "epoch": 3.0,
34
+ "eval_Accuracy": 1.0,
35
+ "eval_F1": 1.0,
36
+ "eval_Precision": 1.0,
37
+ "eval_Recall": 1.0,
38
+ "eval_loss": 1.6744012100389227e-05,
39
+ "eval_runtime": 1.5168,
40
+ "eval_samples_per_second": 100.214,
41
+ "eval_steps_per_second": 12.527,
42
+ "step": 456
43
+ }
44
+ ],
45
+ "logging_steps": 500,
46
+ "max_steps": 456,
47
+ "num_input_tokens_seen": 0,
48
+ "num_train_epochs": 3,
49
+ "save_steps": 500,
50
+ "total_flos": 131122250941500.0,
51
+ "train_batch_size": 8,
52
+ "trial_name": null,
53
+ "trial_params": null
54
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:383e12ef0961e8c6bf1d237a3cc38a355a3dafd121023cb2978ba191ef5a74f7
3
+ size 4984