Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mzayed
/
gemma-7b-it-q4_k_m
like
0
GGUF
Inference Endpoints
License:
gemma-terms-of-use
Model card
Files
Files and versions
Community
Deploy
Use this model
Edit model card
Gemma-7B-it GGUF Quantized
Usage
Gemma-7B-it GGUF Quantized
Usage
This model can be used with the latest version of llama.cpp and LM Studio >0.2.16.
Downloads last month
12
GGUF
Model size
8.54B params
Architecture
gemma
4-bit
Q4_K_M
Inference API
Unable to determine this model's library. Check the
docs
.