1 contributor

History: 18 commits

TheBloke

GGUF model commit (made with llama.cpp commit 8a7b2fa)

8df7e9c 11 months ago

.gitattributes

2.28 kB

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
README.md

19.1 kB

Upload README.md 11 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit 8a7b2fa) 11 months ago
marcoroni-7b-v3.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago
marcoroni-7b-v3.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 11 months ago