TheBloke
/

Sonya-7B-GGUF

Model card Files Files and versions Community

1 contributor

History: 17 commits

TheBloke's picture

Upload README.md

cb99d51 10 months ago

.gitattributes

2.19 kB

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
README.md

23.7 kB

Upload README.md 10 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q3_K_S.gguf

3.17 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago
sonya-7b.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit e39106c) 10 months ago