Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
tsumeone
/
llama-30b-supercot-3bit-128g-cuda
like
3
Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
30B 3bit seems pretty sweet by the official evaluation
2
#1 opened over 1 year ago by
Yhyu13