Hugging Face's logo

second-state
/
Phi-3.5-mini-instruct-GGUF

Text Generation
Transformers
GGUF
multilingual
phi3
nlp
code
custom_code
Inference Endpoints
conversational
Model card Files Community
apepkuss79 commited on
Commit
b7f18b7
•
1 Parent(s): 7938358

Update models

Browse files
Files changed (13) hide show
  1. .gitattributes +12 -0
  2. Phi-3.5-mini-instruct-Q2_K.gguf +3 -0
  3. Phi-3.5-mini-instruct-Q3_K_L.gguf +3 -0
  4. Phi-3.5-mini-instruct-Q3_K_M.gguf +3 -0
  5. Phi-3.5-mini-instruct-Q3_K_S.gguf +3 -0
  6. Phi-3.5-mini-instruct-Q4_0.gguf +3 -0
  7. Phi-3.5-mini-instruct-Q4_K_M.gguf +3 -0
  8. Phi-3.5-mini-instruct-Q4_K_S.gguf +3 -0
  9. Phi-3.5-mini-instruct-Q5_0.gguf +3 -0
  10. Phi-3.5-mini-instruct-Q5_K_S.gguf +3 -0
  11. Phi-3.5-mini-instruct-Q6_K.gguf +3 -0
  12. Phi-3.5-mini-instruct-Q8_0.gguf +3 -0
  13. Phi-3.5-mini-instruct-f16.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Phi-3.5-mini-instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Phi-3.5-mini-instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Phi-3.5-mini-instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Phi-3.5-mini-instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Phi-3.5-mini-instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Phi-3.5-mini-instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Phi-3.5-mini-instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Phi-3.5-mini-instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Phi-3.5-mini-instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Phi-3.5-mini-instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Phi-3.5-mini-instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Phi-3.5-mini-instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Phi-3.5-mini-instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Phi-3.5-mini-instruct-f16.gguf filter=lfs diff=lfs merge=lfs -text
Phi-3.5-mini-instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e6564bea11e9447560fd9a83acac1b248293c2466ffee97683d3bf2288ce8e9
3
+ size 1416204288
Phi-3.5-mini-instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cf63a5a22f926a97b895e60afd722f058844dd00817062d94fa3f7aad6cfcb6
3
+ size 2087597568
Phi-3.5-mini-instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e090e1ea535e89f4f18737dbf1c79bb5a168990159e9d8a6174374fe921096ca
3
+ size 1955476992
Phi-3.5-mini-instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91e2ea239d43ab6e15fb10412425c0d092ed03f7cd1483f7f354a3001f93d67c
3
+ size 1681798656
Phi-3.5-mini-instruct-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cce3a577017b01ed37ae7cf25534c5fd59045d459e0a2249551ec5a2cac6882c
3
+ size 2176177152
Phi-3.5-mini-instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c389ea28dc7f10dfbe30fc5e05452f832b1adf85989253ba590e3620b9584f06
3
+ size 2393232384
Phi-3.5-mini-instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2de4ce8a64658ea9906e3996a6da944d249a0564ac0fa306fdfc09c1253defd
3
+ size 2188760064
Phi-3.5-mini-instruct-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48acfc895623cffb32a45432bbc1134ac5bea4d423fadfd42573088fd45d9840
3
+ size 2641474560
Phi-3.5-mini-instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31e861ead1d275f332b24b7be5ac6ad8dcb41d323b45eaf5d6a6ced820fba2c2
3
+ size 2641474560
Phi-3.5-mini-instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be4239a20c9f0812d799130015a8fc109e1dd3a754245bbe1eb72bf03d700c8d
3
+ size 3135853056
Phi-3.5-mini-instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81fd0b829a6ff15b3df3cc792de3f3e75a9fb2f1f55c0059af55a698b1173150
3
+ size 4061222400
Phi-3.5-mini-instruct-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04381ade8b69632b564f1dbc473dac52f7819349ceb3cc76d268dee91f762fe2
3
+ size 7643297280