Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
xmadai
/
Llama-3.1-405B-Instruct-xMADai-INT4
like
6
Follow
xMAD.ai
14
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
arxiv:
2407.10032
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-405B-Instruct-xMADai-INT4
4 contributors
History:
15 commits
onebitquantized
Update README.md
051a9d7
verified
16 days ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 month ago
README.md
Safe
3.97 kB
Update README.md
16 days ago
config.json
Safe
1.28 kB
Upload of AutoGPTQ quantized model
21 days ago
model.safetensors.index.json
Safe
283 kB
Upload of AutoGPTQ quantized model
21 days ago
model_000.safetensors
Safe
46.1 GB
LFS
Upload of AutoGPTQ quantized model
21 days ago
model_001.safetensors
Safe
46.5 GB
LFS
Upload of AutoGPTQ quantized model
21 days ago
model_002.safetensors
Safe
41.4 GB
LFS
Upload of AutoGPTQ quantized model
21 days ago
model_003.safetensors
Safe
41.7 GB
LFS
Upload of AutoGPTQ quantized model
21 days ago
model_004.safetensors
Safe
41.4 GB
LFS
Upload of AutoGPTQ quantized model
21 days ago
quantize_config.json
Safe
313 Bytes
Upload of AutoGPTQ quantized model
21 days ago
special_tokens_map.json
Safe
296 Bytes
Upload tokenizer
about 1 month ago
tokenizer.json
Safe
9.09 MB
Upload tokenizer
about 1 month ago
tokenizer_config.json
Safe
55.4 kB
Upload tokenizer
about 1 month ago