TheBloke
/

upstage-llama-30b-instruct-2048-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

upstage-llama-30b-instruct-2048-AWQ

1 contributor

History: 8 commits

TheBloke's picture

Update for Transformers AWQ support

ea922fb about 1 year ago