TheBloke
/

notus-7B-v1-GGUF

Text Generation

Model card Files Files and versions Community

notus-7B-v1-GGUF

1 contributor

History: 22 commits

TheBloke's picture

GGUF model commit (made with llama.cpp commit 5c9f90c)

8b27cb4 11 months ago

.gitattributes

2.23 kB

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
README.md

33.4 kB

Upload README.md 11 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
notus-7b-v1.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit 5c9f90c) 11 months ago
notus-7b-v1.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit 5c9f90c) 11 months ago
notus-7b-v1.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit 5c9f90c) 11 months ago
notus-7b-v1.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit 5c9f90c) 11 months ago
notus-7b-v1.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit 5c9f90c) 11 months ago
notus-7b-v1.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
notus-7b-v1.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
notus-7b-v1.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
notus-7b-v1.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
notus-7b-v1.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
notus-7b-v1.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago
notus-7b-v1.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit fbbc428) 11 months ago