Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
SamPurkis
/
Yi-6B-GGUF
like
6
GGUF
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
New: Create and edit this model card directly on the website!
Contribute a Model Card
Downloads last month
27
GGUF
Model size
6.06B params
Architecture
llama
2-bit
Q2_K
4-bit
Q4_K_M
6-bit
Q6_K
8-bit
Q8_0
Inference API
Unable to determine this model's library. Check the
docs
.