legraphista/Phi-3.5-mini-instruct-IMat-GGUF at d51141e3cfaaf6ad54ea9fda0c0b714a68d9728d

Phi-3.5-mini-instruct-IMat-GGUF

1 contributor

History: 46 commits

legraphista's picture

Upload Phi-3.5-mini-instruct.IQ2_XXS.gguf with huggingface_hub

d51141e verified 3 months ago

.gitattributes

3.16 kB

Upload Phi-3.5-mini-instruct.IQ2_XXS.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.BF16.gguf

7.64 GB
LFS

Upload Phi-3.5-mini-instruct.BF16.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.FP16.gguf

7.64 GB
LFS

Upload Phi-3.5-mini-instruct.FP16.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ2_M.gguf

1.32 GB
LFS

Upload Phi-3.5-mini-instruct.IQ2_M.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ2_S.gguf

1.22 GB
LFS

Upload Phi-3.5-mini-instruct.IQ2_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ2_XS.gguf

1.15 GB
LFS

Upload Phi-3.5-mini-instruct.IQ2_XS.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ2_XXS.gguf

1.04 GB
LFS

Upload Phi-3.5-mini-instruct.IQ2_XXS.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ3_M.gguf

1.86 GB
LFS

Upload Phi-3.5-mini-instruct.IQ3_M.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ3_S.gguf

1.68 GB
LFS

Upload Phi-3.5-mini-instruct.IQ3_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ3_XS.gguf

1.63 GB
LFS

Upload Phi-3.5-mini-instruct.IQ3_XS.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ3_XXS.gguf

1.51 GB
LFS

Upload Phi-3.5-mini-instruct.IQ3_XXS.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ4_NL.gguf

2.18 GB
LFS

Upload Phi-3.5-mini-instruct.IQ4_NL.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.IQ4_XS.gguf

2.06 GB
LFS

Upload Phi-3.5-mini-instruct.IQ4_XS.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q2_K.gguf

1.42 GB
LFS

Upload Phi-3.5-mini-instruct.Q2_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q2_K_S.gguf

1.33 GB
LFS

Upload Phi-3.5-mini-instruct.Q2_K_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q3_K.gguf

1.96 GB
LFS

Upload Phi-3.5-mini-instruct.Q3_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q3_K_L.gguf

2.09 GB
LFS

Upload Phi-3.5-mini-instruct.Q3_K_L.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q3_K_S.gguf

1.68 GB
LFS

Upload Phi-3.5-mini-instruct.Q3_K_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q4_K.gguf

2.39 GB
LFS

Upload Phi-3.5-mini-instruct.Q4_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q4_K_S.gguf

2.19 GB
LFS

Upload Phi-3.5-mini-instruct.Q4_K_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q5_K.gguf

2.82 GB
LFS

Upload Phi-3.5-mini-instruct.Q5_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q5_K_S.gguf

2.64 GB
LFS

Upload Phi-3.5-mini-instruct.Q5_K_S.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q6_K.gguf

3.14 GB
LFS

Upload Phi-3.5-mini-instruct.Q6_K.gguf with huggingface_hub 3 months ago
Phi-3.5-mini-instruct.Q8_0.gguf

4.06 GB
LFS

Upload Phi-3.5-mini-instruct.Q8_0.gguf with huggingface_hub 3 months ago
README.md

9.82 kB

Upload README.md with huggingface_hub 3 months ago
imatrix.dat

2.23 MB
LFS

Upload imatrix.dat with huggingface_hub 3 months ago
imatrix.dataset

280 kB

Upload imatrix.dataset with huggingface_hub 3 months ago
imatrix.log

12.3 kB

Upload imatrix.log with huggingface_hub 3 months ago