neuralmagic
/

Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

alexmarques commited on Aug 13

Commit

2bfe93f

•

1 Parent(s): 44910a5

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -1,4 +1,7 @@
 ---
 language:
 - en
 - de
@@ -10,6 +13,7 @@ language:
 - th
 pipeline_tag: text-generation
 license: llama3.1
 ---
 # Meta-Llama-3.1-8B-Instruct-quantized.w8a8

 ---
+tags:
+- int8
+- vllm
 language:
 - en
 - de
 - th
 pipeline_tag: text-generation
 license: llama3.1
+base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
 ---
 # Meta-Llama-3.1-8B-Instruct-quantized.w8a8