GGUF model commit (made with llama.cpp commit e18f734)

bdd820c 10 months ago

.gitattributes

2.28 kB

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago
marcoroni-7b-v3.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit e18f734) 10 months ago