solidrust
/

LLama-3.1-8B-Matrix-AWQ

Text Generation

4-bit precision

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

LLama-3.1-8B-Matrix-AWQ / model-00002-of-00002.safetensors

Commit History

Upload quantized AWQ model

64ebf9c
verified

Suparious commited on Sep 19