1 contributor

History: 17 commits

TheBloke

GGUF model commit (made with llama.cpp commit 57d016b)

aa4bcbc 11 months ago

.gitattributes

2.3 kB

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
README.md

34 kB

Upload README.md 11 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit 57d016b) 11 months ago
openchat-3.5-0106.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit 57d016b) 11 months ago
openchat-3.5-0106.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago
openchat-3.5-0106.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit 4f56458) 11 months ago