Nick088 commited on
Commit
8012423
1 Parent(s): 5499d96

Use the right tokenizer

Browse files

As its a finetune of the Google Flan T5 Small model, the tokenizer its the same, so there isn't really a reason to use the base model repo tokenizer when you can just use the one of your own model as its like a duplicate one

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -24,7 +24,7 @@ pip install transformers
24
  ```python
25
  from transformers import T5Tokenizer, T5ForConditionalGeneration
26
 
27
- tokenizer = T5Tokenizer.from_pretrained("google/flan-t5-small")
28
  model = T5ForConditionalGeneration.from_pretrained("roborovski/superprompt-v1", device_map="auto")
29
 
30
  input_text = "Expand the following prompt to add more detail: A storefront with 'Text to Image' written on it."
 
24
  ```python
25
  from transformers import T5Tokenizer, T5ForConditionalGeneration
26
 
27
+ tokenizer = T5Tokenizer.from_pretrained("roborovski/superprompt-v1")
28
  model = T5ForConditionalGeneration.from_pretrained("roborovski/superprompt-v1", device_map="auto")
29
 
30
  input_text = "Expand the following prompt to add more detail: A storefront with 'Text to Image' written on it."