Locutusque
commited on
Commit
•
045ee35
1
Parent(s):
829c8a4
Update README.md
Browse files
README.md
CHANGED
@@ -100,8 +100,8 @@ def generate_text(model, tokenizer, prompt, max_length=1024):
|
|
100 |
output = model.generate(input_ids,
|
101 |
max_length=max_length,
|
102 |
do_sample=True,
|
103 |
-
top_k=
|
104 |
-
top_p=0.
|
105 |
pad_token_id=tokenizer.pad_token_id,
|
106 |
eos_token_id=tokenizer.eos_token_id,
|
107 |
attention_mask=attention_mask)
|
@@ -119,4 +119,4 @@ while True:
|
|
119 |
print(output_text)
|
120 |
```
|
121 |
## Deploying and training the model
|
122 |
-
The model has been fine-tuned on a specific input format that goes like this ```"<|
|
|
|
100 |
output = model.generate(input_ids,
|
101 |
max_length=max_length,
|
102 |
do_sample=True,
|
103 |
+
top_k=35,
|
104 |
+
top_p=0.80,
|
105 |
pad_token_id=tokenizer.pad_token_id,
|
106 |
eos_token_id=tokenizer.eos_token_id,
|
107 |
attention_mask=attention_mask)
|
|
|
119 |
print(output_text)
|
120 |
```
|
121 |
## Deploying and training the model
|
122 |
+
The model has been fine-tuned on a specific input format that goes like this ```"<|USER|> {user prompt} <|ASSISTANT|> {model prediction} <|End|>".``` For the best performance from the model the input text should be as follows ```<|USER|> {user prompt} <|ASSISTANT|> ``` and the target/label should be as follows ```<|USER|> {user prompt} <|ASSISTANT|> {dataset output} <|End|>```
|