Hugging Face's logo

ZeroWw
/
Phi-3-mini-4k-instruct-GGUF

Text Generation
GGUF
English
Inference Endpoints
conversational
Model card Files Community
1
ZeroWw commited on
Commit
45a7f8e
•
1 Parent(s): 12a89de

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +2 -0
  2. Phi-3-mini-4k-instruct.f16.gguf +2 -2
  3. Phi-3-mini-4k-instruct.q5_k.gguf +2 -2
  4. Phi-3-mini-4k-instruct.q6_k.gguf +2 -2
  5. Phi-3-mini-4k-instruct.q8_0.gguf +2 -2
  6. Phi-3-mini-4k-instruct.q8_p.gguf +3 -0
  7. Phi-3-mini-4k-instruct.q8q4.gguf +3 -0
  8. README.md +2 -1
.gitattributes CHANGED
@@ -37,3 +37,5 @@ Phi-3-mini-4k-instruct.f16.gguf filter=lfs diff=lfs merge=lfs -text
37
  Phi-3-mini-4k-instruct.q5_k.gguf filter=lfs diff=lfs merge=lfs -text
38
  Phi-3-mini-4k-instruct.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
39
  Phi-3-mini-4k-instruct.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
37
  Phi-3-mini-4k-instruct.q5_k.gguf filter=lfs diff=lfs merge=lfs -text
38
  Phi-3-mini-4k-instruct.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
39
  Phi-3-mini-4k-instruct.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Phi-3-mini-4k-instruct.q8_p.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Phi-3-mini-4k-instruct.q8q4.gguf filter=lfs diff=lfs merge=lfs -text
Phi-3-mini-4k-instruct.f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75ae3a460cb3a7292354e8b983e3a651b0333d3fb91bc1096433321b03787989
3
- size 7643296192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe4c64522173db6b3dae84ae667f6a8ad9e6cbc767f37ef165addbed991b129d
3
+ size 7643296704
Phi-3-mini-4k-instruct.q5_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:31889d9c6c18f22f5bc0817b2f08b843dde6a069317a9b26a248e5b59cdadd6c
3
- size 3060756928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9419d0886f62acc412761b7281e1c4a75f5d8e3ae82f133bcc1d5c7755e53678
3
+ size 3060757440
Phi-3-mini-4k-instruct.q6_k.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:34f4ce5d4108186c29962faf8e2a7cab2cc484649a958b984bd4dd7e32c3d0e5
3
- size 3368251840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:707a2b6c43d03ae79bb04b10afa6875d2f802af16b2af10a779d43534a7a8334
3
+ size 3368252352
Phi-3-mini-4k-instruct.q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f737bbe1079746985677d2df2b37ece8fd86fba9210f9deab556f90dac985989
3
- size 4245909952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:787a2708c59a78d021f8468f7ad7e3cf60fa91ced92bd648681e85f1db60f2ac
3
+ size 4245910464
Phi-3-mini-4k-instruct.q8_p.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ed91b19c44c8c92f130aa922e05df1b76b709c5792788a24e7321945d100f75
3
+ size 4061221824
Phi-3-mini-4k-instruct.q8q4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a484c128b1b1fd158b8795035c80b8dff206b142601397345428b183ae51adad
3
+ size 2466337728
README.md CHANGED
@@ -3,6 +3,7 @@
3
  license: mit
4
  language:
5
  - en
 
6
  ---
7
 
8
  My own (ZeroWw) quantizations.
@@ -13,4 +14,4 @@ Result:
13
  both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
14
  and they perform as well as the pure f16.
15
 
16
- Updated on: Tue Jul 2, 20:00:00
 
3
  license: mit
4
  language:
5
  - en
6
+ pipeline_tag: text-generation
7
  ---
8
 
9
  My own (ZeroWw) quantizations.
 
14
  both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
15
  and they perform as well as the pure f16.
16
 
17
+ Updated on: Sat Aug 10, 13:12:32