Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
solidrust
/
LLama-3.1-8B-Matrix-AWQ
like
1
Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
Inference Endpoints
text-generation-inference
awq
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
LLama-3.1-8B-Matrix-AWQ
1 contributor
History:
4 commits
Suparious
Upload quantized AWQ model
64ebf9c
verified
11 days ago
.gitattributes
1.52 kB
initial commit
11 days ago
README.md
2.83 kB
Update README after successful quantization
11 days ago
config.json
1.14 kB
Upload quantized AWQ model
11 days ago
generation_config.json
168 Bytes
Upload quantized AWQ model
11 days ago
model-00001-of-00002.safetensors
4.68 GB
LFS
Upload quantized AWQ model
11 days ago
model-00002-of-00002.safetensors
1.05 GB
LFS
Upload quantized AWQ model
11 days ago
model.safetensors.index.json
63.5 kB
Upload quantized AWQ model
11 days ago
special_tokens_map.json
459 Bytes
Upload quantized AWQ model
11 days ago
tokenizer.json
9.09 MB
Upload quantized AWQ model
11 days ago
tokenizer_config.json
50.6 kB
Upload quantized AWQ model
11 days ago