GGUF model commit (made with llama.cpp commit 4a4fd3e)

3ff508f 12 months ago

.gitattributes

2.22 kB

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
README.md

21.6 kB

Upload README.md 12 months ago
config.json

26 Bytes

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q2_K.gguf

2.62 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q3_K_L.gguf

3.24 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q3_K_M.gguf

2.99 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q3_K_S.gguf

2.71 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q4_0.gguf

3.48 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q4_K_M.gguf

3.67 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q4_K_S.gguf

3.5 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q5_0.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q5_K_M.gguf

4.3 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q5_K_S.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q6_K.gguf

4.97 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago
yi-6b-200k.Q8_0.gguf

6.44 GB
LFS

GGUF model commit (made with llama.cpp commit df9d129) 12 months ago