Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ikawrakow
/
various-2bit-sota-gguf
like
80
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
13
Deploy
Use this model
d46804d
various-2bit-sota-gguf
1 contributor
History:
12 commits
ikawrakow
Adding Mistral instruct models
d46804d
10 months ago
.gitattributes
Safe
1.56 kB
Adding first set of models
10 months ago
README.md
Safe
384 Bytes
Update README.md
10 months ago
llama-v2-13b-2.17bpw.gguf
Safe
3.54 GB
LFS
Adding first set of models
10 months ago
llama-v2-13b-2.39bpw.gguf
Safe
3.89 GB
LFS
Adding 2.31-bpw base quantized models
10 months ago
llama-v2-70b-2.12bpw.gguf
Safe
18.3 GB
LFS
Adding more
10 months ago
llama-v2-70b-2.36bpw.gguf
Safe
20.3 GB
LFS
Adding 2.31-bpw base quantized models
10 months ago
llama-v2-7b-2.20bpw.gguf
Safe
1.85 GB
LFS
Adding first set of models
10 months ago
llama-v2-7b-2.42bpw.gguf
Safe
2.03 GB
LFS
Adding 2.31-bpw base quantized models
10 months ago
mistral-7b-2.20bpw.gguf
Safe
1.99 GB
LFS
Adding first set of models
10 months ago
mistral-7b-2.43bpw.gguf
Safe
2.2 GB
LFS
Adding 2.31-bpw base quantized models
10 months ago
mistral-instruct-7b-2.43bpw.gguf
Safe
2.2 GB
LFS
Adding Mistral instruct models
10 months ago
mixtral-8x7b-2.10bpw.gguf
Safe
12.3 GB
LFS
Adding Mixtral-8x7b
10 months ago
mixtral-8x7b-2.34bpw.gguf
Safe
13.7 GB
LFS
Adding 2.31-bpw base quantized models
10 months ago
mixtral-instruct-8x7b-2.10bpw.gguf
Safe
12.3 GB
LFS
Adding Mixtral-instruct-8x7b
10 months ago
mixtral-instruct-8x7b-2.34bpw.gguf
Safe
13.7 GB
LFS
Adding Mistral instruct models
10 months ago
nous-hermes-2-10.7b-2.18bpw.gguf
Safe
2.92 GB
LFS
Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants
10 months ago
nous-hermes-2-10.7b-2.70bpw.gguf
Safe
3.62 GB
LFS
Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants
10 months ago
nous-hermes-2-34b-2.16bpw.gguf
Safe
9.31 GB
LFS
Adding Nous-Hermes-2-Yi-34B 2-bit quants
10 months ago
nous-hermes-2-34b-2.69bpw.gguf
Safe
11.6 GB
LFS
Adding Nous-Hermes-2-Yi-34B 2-bit quants
10 months ago
rocket-3b-2.31bpw.gguf
Safe
808 MB
LFS
Adding Rocket-3b 2-bit quants
10 months ago
rocket-3b-2.76bpw.gguf
Safe
967 MB
LFS
Adding Rocket-3b 2-bit quants
10 months ago