linjc16
/

Panacea-7B-Chat

Text Generation

foundation model

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

linjc16 commited on Sep 27

Commit

74b490c

•

1 Parent(s): 3eda305

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -23,11 +23,11 @@ Panacea is trained from [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistr
 Load the model in the following way (same as Mistral):
-```[python]
 from transformers import AutoModelForCausalLM, AutoTokenizer
 import torch
 model_id = 'linjc16/Panacea-7B-Chat'
-model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto", cache_dir="/data/jl254/cache/")
 tokenizer = AutoTokenizer.from_pretrained(model_id)

 Load the model in the following way (same as Mistral):
+```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
 import torch
 model_id = 'linjc16/Panacea-7B-Chat'
+model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto")
 tokenizer = AutoTokenizer.from_pretrained(model_id)