|
--- |
|
tags: |
|
- generated_from_keras_callback |
|
model-index: |
|
- name: CodeGeneration-CodeT5-base |
|
results: [] |
|
datasets: |
|
- ThoughtFocusAI/Python-CodeGeneration |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information Keras had access to. You should |
|
probably proofread and complete it, then remove this comment. --> |
|
|
|
# CodeGeneration-CodeT5-base |
|
|
|
This model was trained from the pretrained CodeT5-base model on [ThoughtFocusAI/Python-CodeGeneration](https://huggingface.co/datasets/ThoughtFocusAI/Python-CodeGeneration) dataset. |
|
It achieves the following results on the evaluation set: |
|
- ngram match: 0.014948515566713798 |
|
- weighted ngram match: 0.017803898905793227 |
|
- syntax_match: 0.21961325966850828 |
|
- dataflow_match: 0.36255924170616116 |
|
- bleu = 1.87 |
|
- codebleu = 15.3731 |
|
- exact match = 0.0 |
|
|
|
|
|
## Model description |
|
|
|
This model was trained from the pretrained CodeT5-base model Salesforce and has been fine tuned for Python Code Genertion. |
|
|
|
## Intended uses & limitations |
|
|
|
Python Code Generation. |
|
Limited to simple queries. |
|
|
|
## Training and evaluation data |
|
|
|
[ThoughtFocusAI/Python-CodeGeneration](https://huggingface.co/datasets/ThoughtFocusAI/Python-CodeGeneration) |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- optimizer: None |
|
- training_precision: float32 |
|
|
|
### Training results |
|
|
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.29.2 |
|
- TensorFlow 2.12.0 |
|
- Datasets 2.12.0 |
|
- Tokenizers 0.13.3 |