Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Deci
/
DeciLM-7B-instruct-GGUF
like
40
Text Generation
Transformers
GGUF
llama
text-generation-inference
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
DeciLM-7B-instruct-GGUF
3 contributors
History:
16 commits
harpreetsahota
Create config.json
9d724a1
verified
7 months ago
.gitattributes
1.72 kB
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
9 months ago
README.md
2.72 kB
Update README.md
9 months ago
config.json
675 Bytes
Create config.json
7 months ago
decilm-7b-uniform-gqa-f16.gguf
14.2 GB
LFS
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
9 months ago
decilm-7b-uniform-gqa-f32.gguf
28.4 GB
LFS
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
9 months ago
decilm-7b-uniform-gqa-q8_0.gguf
7.55 GB
LFS
Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.
9 months ago