Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ikawrakow
/
mistral-7b-quantized-gguf
like
5
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
main
mistral-7b-quantized-gguf
/
mistral-7b-q51.gguf
Commit History
Adding 2-bit and large 5-bit quants
86ea5c5
ikawrakow
commited on
Dec 7, 2023
ikawrakow
commited on
