Text Generation
Transformers
GGUF
PyTorch
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Generated from Trainer
en
dataset:HuggingFaceH4/ultrachat_200k
dataset:HuggingFaceH4/ultrafeedback_binarized
arxiv:2305.18290
arxiv:2310.16944
Eval Results
Inference Endpoints
has_space
text-generation-inference
conversational
Commit
•
310155b
1
Parent(s):
efeb54a
Rename file.
Browse files
.gitattributes
CHANGED
|
@@ -43,3 +43,4 @@ zephyr-7b-beta.Q5_K_M.ggufm filter=lfs diff=lfs merge=lfs -text
|
|
| 43 |
zephyr-7b-beta.Q5_K_S.ggufm filter=lfs diff=lfs merge=lfs -text
|
| 44 |
zephyr-7b-beta.Q6_K.ggufm filter=lfs diff=lfs merge=lfs -text
|
| 45 |
zephyr-7b-beta.Q8_0.ggufm filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 43 |
zephyr-7b-beta.Q5_K_S.ggufm filter=lfs diff=lfs merge=lfs -text
|
| 44 |
zephyr-7b-beta.Q6_K.ggufm filter=lfs diff=lfs merge=lfs -text
|
| 45 |
zephyr-7b-beta.Q8_0.ggufm filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
zephyr-7b-beta.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
zephyr-7b-beta.Q2_K.ggufm → zephyr-7b-beta.Q2_K.gguf
RENAMED
|
File without changes
|