Hugging Face's logo

SashaSheykina
/
codeT5-finetuned-cXg-nl-to-code

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
code-generation
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
SashaSheykina commited on
Commit
75949fa
•
1 Parent(s): f91760c

Training complete

Browse files
Files changed (2) hide show
  1. README.md +13 -11
  2. runs/Aug03_10-00-30_ad256a0a023e/events.out.tfevents.1722680020.ad256a0a023e.7051.1 +3 -0
README.md CHANGED
@@ -19,13 +19,13 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [Salesforce/codet5-base](https://huggingface.co/Salesforce/codet5-base) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 1.5944
23
- - Rouge1: 0.0735
24
- - Rouge2: 0.0022
25
- - Rougel: 0.0671
26
- - Bleu: 0.7231
27
- - Meteor: 0.0630
28
- - Codebleu: 0.0382
29
 
30
  ## Model description
31
 
@@ -50,16 +50,18 @@ The following hyperparameters were used during training:
50
  - seed: 42
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
- - num_epochs: 3
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Bleu | Meteor | Codebleu |
59
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:------:|:------:|:--------:|
60
- | No log | 1.0 | 4 | 4.8941 | 0.0196 | 0.004 | 0.0201 | 0.0446 | 0.0142 | 0.0146 |
61
- | No log | 2.0 | 8 | 2.1851 | 0.0519 | 0.0019 | 0.0519 | 0.1178 | 0.0281 | 0.0217 |
62
- | No log | 3.0 | 12 | 1.5944 | 0.0731 | 0.0022 | 0.0670 | 0.1442 | 0.0596 | 0.0246 |
 
 
63
 
64
 
65
  ### Framework versions
 
19
 
20
  This model is a fine-tuned version of [Salesforce/codet5-base](https://huggingface.co/Salesforce/codet5-base) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.8873
23
+ - Rouge1: 0.1077
24
+ - Rouge2: 0.0133
25
+ - Rougel: 0.1043
26
+ - Bleu: 3.0765
27
+ - Meteor: 0.1706
28
+ - Codebleu: 0.0498
29
 
30
  ## Model description
31
 
 
50
  - seed: 42
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 5
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Bleu | Meteor | Codebleu |
59
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:------:|:------:|:--------:|
60
+ | No log | 1.0 | 4 | 2.1149 | 0.0415 | 0.0010 | 0.0417 | 0.0629 | 0.0236 | 0.0177 |
61
+ | No log | 2.0 | 8 | 1.5027 | 0.0719 | 0.0028 | 0.0709 | 0.0682 | 0.0383 | 0.0201 |
62
+ | No log | 3.0 | 12 | 1.0964 | 0.0913 | 0.0106 | 0.0916 | 0.3613 | 0.1050 | 0.0267 |
63
+ | No log | 4.0 | 16 | 0.9316 | 0.1012 | 0.012 | 0.0979 | 0.6845 | 0.1369 | 0.0317 |
64
+ | No log | 5.0 | 20 | 0.8873 | 0.1058 | 0.012 | 0.1007 | 0.7454 | 0.1497 | 0.0338 |
65
 
66
 
67
  ### Framework versions
runs/Aug03_10-00-30_ad256a0a023e/events.out.tfevents.1722680020.ad256a0a023e.7051.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97fe67943c7f0e83f5d7b92bd4570e36d4875316eabf3428568fe3aed4b80fd7
3
+ size 648