Hugging Face's logo

lmstudio-community
/
Phi-3.1-mini-4k-instruct-GGUF

Text Generation
GGUF
English
nlp
code
Inference Endpoints
imatrix
conversational
Model card Files Community
bartowski commited on
Commit
9f95941
•
1 Parent(s): 6657fda

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +1 -0
  2. Phi-3.1-mini-4k-instruct-IQ3_M.gguf +2 -2
  3. Phi-3.1-mini-4k-instruct-IQ4_XS.gguf +2 -2
  4. Phi-3.1-mini-4k-instruct-Q3_K_L.gguf +2 -2
  5. Phi-3.1-mini-4k-instruct-Q4_K_M.gguf +2 -2
  6. Phi-3.1-mini-4k-instruct-Q5_K_M-take2.gguf +3 -0
  7. Phi-3.1-mini-4k-instruct-Q6_K.gguf +2 -2
  8. Phi-3.1-mini-4k-instruct-Q8_0.gguf +2 -2
.gitattributes CHANGED
@@ -58,3 +58,4 @@ Phi-3.1-mini-4k-instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
58
  Phi-3.1-mini-4k-instruct-Q8_0_L.gguf filter=lfs diff=lfs merge=lfs -text
59
  Phi-3.1-mini-4k-instruct-f32.gguf filter=lfs diff=lfs merge=lfs -text
60
  Phi-3.1-mini-4k-instruct.imatrix filter=lfs diff=lfs merge=lfs -text
 
 
58
  Phi-3.1-mini-4k-instruct-Q8_0_L.gguf filter=lfs diff=lfs merge=lfs -text
59
  Phi-3.1-mini-4k-instruct-f32.gguf filter=lfs diff=lfs merge=lfs -text
60
  Phi-3.1-mini-4k-instruct.imatrix filter=lfs diff=lfs merge=lfs -text
61
+ Phi-3.1-mini-4k-instruct-Q5_K_M-take2.gguf filter=lfs diff=lfs merge=lfs -text
Phi-3.1-mini-4k-instruct-IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ca9b164a58ddd7d48b658e26bded82c8eed963c342e25b39c4c6b88af48c5357
3
- size 1855599328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37d43807d96a0866d6e3a74d54ea34bb5363c2597acd6c32805c84b5236934e5
3
+ size 1855599840
Phi-3.1-mini-4k-instruct-IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d5f6f8af479c36ef6fae6159d9a2721b9ebb6774a5632206b76aba93a1152d68
3
- size 2059852000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e5c2cddeabe4c29aa68a2cbda2ecf5abe52645bc4a06c8f77488ecbb1fd4c1a
3
+ size 2059852512
Phi-3.1-mini-4k-instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:95c0198bc43c89a6993e45789d902062f96b04dbf4d774f9120fd9de15069703
3
- size 2087596768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df590d9557361d473a8acb0b9d53afafd4f70b496b64c3c471d3b34997ce2833
3
+ size 2087597280
Phi-3.1-mini-4k-instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:39458b227a4be763b7eb39d306d240c3d45205e3f8b474ec7bdca7bba0158e69
3
- size 2393231584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6d25bf078321bea4a079c727b273cb0b5a2e0b4cf3add0f7a2c8e43075c414f
3
+ size 2393232096
Phi-3.1-mini-4k-instruct-Q5_K_M-take2.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e6b40db29b0f6d17fe2969a85e6079a8e8f28f1ab549dbb9b3c52dad8189319
3
+ size 2815275744
Phi-3.1-mini-4k-instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bb351805ef1513ab473792bdf5357f27beb5a22b68d11e47ef735fa682e30ed
3
- size 3135852256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33b039925724d156dd62bb0fdd2719b7b6fa9d71e1a56796c8f41bd7d122162d
3
+ size 3135852768
Phi-3.1-mini-4k-instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dcf4f75cc9df7fdc487589e5e9624f4b8486a533135c5df294037c2678cc13ca
3
- size 4061221600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec1d9f9bd11ff1b360df7f3d92b11612dfe0dbe7ae66eff9c6f334a22da32952
3
+ size 4061222112