jordiclive
/

scaled-llama-7b-lora-16k-rp2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

jordiclive commited on Jul 13, 2023

Commit

2b63459

•

1 Parent(s): 20fdb0a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ model = AutoModelForCausalLM.from_pretrained(
     torch_dtype=torch.float16,trust_remote_code=True
 )
 tokenizer = LlamaTokenizerFast.from_pretrained(
-        model_name, add_bos_token=False)
 tokenizer.model_max_length = 16384

     torch_dtype=torch.float16,trust_remote_code=True
 )
 tokenizer = LlamaTokenizerFast.from_pretrained(
+        model_name)
 tokenizer.model_max_length = 16384