Davidsamuel101 commited on
Commit
34a1307
1 Parent(s): 943d9c4

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +68 -0
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - generated_from_trainer
5
+ model-index:
6
+ - name: byt5-small-wikipron-eng-latn-us-broad-p2g
7
+ results: []
8
+ ---
9
+
10
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
+ should probably proofread and complete it, then remove this comment. -->
12
+
13
+ # byt5-small-wikipron-eng-latn-us-broad-p2g
14
+
15
+ This model is a fine-tuned version of [google/byt5-small](https://huggingface.co/google/byt5-small) on the None dataset.
16
+ It achieves the following results on the evaluation set:
17
+ - Loss: 0.2595
18
+ - Per: 0.4628
19
+ - Gen Len: 8.4996
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 0.0002
39
+ - train_batch_size: 128
40
+ - eval_batch_size: 32
41
+ - seed: 42
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
+ - lr_scheduler_type: linear
44
+ - lr_scheduler_warmup_ratio: 0.1
45
+ - num_epochs: 10.0
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss | Per | Gen Len |
50
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
51
+ | 2.4797 | 1.0 | 382 | 0.4371 | 0.6951 | 8.4302 |
52
+ | 0.4823 | 2.0 | 764 | 0.3543 | 0.5974 | 8.4338 |
53
+ | 0.3878 | 3.0 | 1146 | 0.3081 | 0.545 | 8.4394 |
54
+ | 0.3378 | 4.0 | 1528 | 0.2904 | 0.518 | 8.449 |
55
+ | 0.3061 | 5.0 | 1910 | 0.2736 | 0.5004 | 8.4612 |
56
+ | 0.2823 | 6.0 | 2292 | 0.2664 | 0.4893 | 8.4734 |
57
+ | 0.265 | 7.0 | 2674 | 0.2626 | 0.4747 | 8.4721 |
58
+ | 0.2502 | 8.0 | 3056 | 0.2612 | 0.4697 | 8.4945 |
59
+ | 0.2388 | 9.0 | 3438 | 0.2592 | 0.4633 | 8.489 |
60
+ | 0.231 | 10.0 | 3820 | 0.2595 | 0.4628 | 8.4996 |
61
+
62
+
63
+ ### Framework versions
64
+
65
+ - Transformers 4.28.1
66
+ - Pytorch 2.0.0+cu117
67
+ - Datasets 2.11.1.dev0
68
+ - Tokenizers 0.13.2