Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
AetherArchitectural
/
GGUF-Quantization-Script
like
62
Follow
AetherArchitectural
4
Text Generation
GGUF
quantized
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
37
Deploy
e7620c4
GGUF-Quantization-Script
5 contributors
History:
77 commits
FantasiaFoundry
Virt-io
Linux support for BF16 (
#36
)
e7620c4
verified
4 months ago
imatrix
Upload 2 files
9 months ago
.gitattributes
Safe
1.52 kB
initial commit
9 months ago
README.md
Safe
4.39 kB
Update README.md
5 months ago
gguf-imat-for-FP16.py
Safe
7.71 kB
match new script name (#34)
5 months ago
gguf-imat-lossless-for-BF16-linux.py
Safe
9.31 kB
Linux support for BF16 (#36)
4 months ago
gguf-imat-lossless-for-BF16.py
Safe
8.36 kB
match new script name (#35)
5 months ago
gguf-imat.py
Safe
7.7 kB
Forgot to double check. (#24)
7 months ago
requirements.txt
Safe
273 Bytes
Update requirements.txt
5 months ago