GGUF model commit (made with llama.cpp commit d96ca7d)

98f9ed7 12 months ago

.gitattributes

2.22 kB

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
README.md

21.7 kB

Upload README.md 12 months ago
config.json

26 Bytes

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q2_K.gguf

2.62 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q3_K_L.gguf

3.24 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q3_K_M.gguf

2.99 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q3_K_S.gguf

2.71 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q4_0.gguf

3.48 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q4_K_M.gguf

3.67 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q4_K_S.gguf

3.5 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q5_0.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q5_K_M.gguf

4.3 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q5_K_S.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q6_K.gguf

4.97 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago
yi-6b-200k.Q8_0.gguf

6.44 GB
LFS

GGUF model commit (made with llama.cpp commit d96ca7d) 12 months ago