neuralmagic
/

Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

alexmarques commited on Jul 17

Commit

0ac42ef

•

1 Parent(s): cb167f6

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -4,7 +4,7 @@ language:
 pipeline_tag: text-generation
 ---
-# Meta-Llama-3-8B-Instruct-quantized.w8a16
 ## Model Overview
 - **Model Architecture:** Meta-Llama-3

 pipeline_tag: text-generation
 ---
+# Meta-Llama-3-8B-Instruct-quantized.w8a8
 ## Model Overview
 - **Model Architecture:** Meta-Llama-3