elinas
/

alpaca-30b-lora-int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (14)

Compatible with transformers APIs?

#18 opened over 1 year ago by

qiz

How to get this running on Oobabooga with RTX 4080 16GB?

#17 opened over 1 year ago by

I'm getting 0.4 tokens/s on a 4090

#16 opened over 1 year ago by

.pt version uses 2gb less VRAM for me than the non-groupsized .safetensors

#10 opened over 1 year ago by