Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Joseph717171
/
Models
like
3
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
New: Create and edit this model card directly on the website!
Contribute a Model Card
Downloads last month
1,586
GGUF
Model size
7.62B params
Architecture
qwen2
4-bit
Q4_K_M
6-bit
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
8-bit
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
32-bit
F32
Inference API
Unable to determine this model's library. Check the
docs
.