TheBloke
/

sheep-duck-llama-2-70B-v1.1-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

sheep-duck-llama-2-70B-v1.1-AWQ

1 contributor

History: 5 commits

TheBloke's picture

Update for Transformers AWQ support

87e7397 about 1 year ago