mradermacher
/

speechless-instruct-mistral-7b-v0.2-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

speechless-instruct-mistral-7b-v0.2-i1-GGUF

1 contributor

History: 16 commits

mradermacher's picture

uploaded from db2

27d816c verified 11 days ago

.gitattributes

2.61 kB

uploaded from db2 11 days ago
README.md

251 Bytes

uploaded from db2 11 days ago
imatrix.dat

4.99 MB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-IQ1_M.gguf

1.75 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-IQ2_M.gguf

2.5 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-IQ2_XXS.gguf

1.99 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-IQ3_M.gguf

3.28 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-IQ3_XXS.gguf

2.83 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-IQ4_XS.gguf

3.91 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-Q2_K.gguf

2.72 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-Q3_K_M.gguf

3.52 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-Q3_K_S.gguf

3.16 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-Q4_K_M.gguf

4.37 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-Q4_K_S.gguf

4.14 GB
LFS

uploaded from db2 11 days ago
speechless-instruct-mistral-7b-v0.2.i1-Q6_K.gguf

5.94 GB
LFS

uploaded from db2 11 days ago