PerRing
/

llama-3-Korean-Bllossom-8B-fp8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

PerRing commited on Aug 1

Commit

0257105

•

1 Parent(s): 09b9df3

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -12,8 +12,9 @@ pip install --upgrade accelerate fbgemm-gpu torch
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
-tokenizer = AutoTokenizer.from_pretrained("PerRing/llama-3-Korean-Bllossom-8B-fp8")
-model = AutoModelForCausalLM.from_pretrained("PerRing/llama-3-Korean-Bllossom-8B-fp8",device_map='auto')
 ```
 ```python

 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
+model_id="PerRing/llama-3-Korean-Bllossom-8B-fp8"
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id,device_map='auto')
 ```
 ```python