saucam
/

aqua-smaug-0.2-8B

Text Generation

cognitivecomputations/dolphin-2.9-llama3-8b

abacusai/Llama-3-Smaug-8B

meta-llama/Meta-Llama-3-8B

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

saucam commited on Apr 22

Commit

dbf0591

•

1 Parent(s): e0d6329

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -27,7 +27,8 @@ models:
   - model: meta-llama/Meta-Llama-3-8B
 merge_method: model_stock
 base_model: meta-llama/Meta-Llama-3-8B
-dtype: bfloat16```
 ## 💻 Usage
@@ -52,4 +53,4 @@ pipeline = transformers.pipeline(
 outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
 print(outputs[0]["generated_text"])
-```

   - model: meta-llama/Meta-Llama-3-8B
 merge_method: model_stock
 base_model: meta-llama/Meta-Llama-3-8B
+dtype: bfloat16
+```
 ## 💻 Usage
 outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
 print(outputs[0]["generated_text"])
+```