CarperAI
/

diff-codegen-350m-v2

Text Generation

code-generation

Inference Endpoints

Model card Files Files and versions Community

HyperionHF commited on Jan 24, 2023

Commit

8806fce

•

1 Parent(s): a52cb6f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -33,7 +33,7 @@ Our dataset for this fine-tune consists of commits from GitHub, obtained using t
 Our diff model was trained on a dataset of commits from BigQuery, a large-scale dataset of many programming languages from GitHub repositories. We filtered the dataset by the number of stars in the repository (>100 stars), license (only open-source non-copyleft licensed code included), and length of file (files greater than 2048 tokens in length were excluded).
-The model was trained using the GPT-2 tokenizer.
 ## Training Details

 Our diff model was trained on a dataset of commits from BigQuery, a large-scale dataset of many programming languages from GitHub repositories. We filtered the dataset by the number of stars in the repository (>100 stars), license (only open-source non-copyleft licensed code included), and length of file (files greater than 2048 tokens in length were excluded).
+The model was trained using the Huggingface Codegen tokenizer.
 ## Training Details