TheBloke
/

model_007-70B-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

model_007-70B-AWQ

1 contributor

History: 5 commits

TheBloke's picture

Update for Transformers AWQ support

93407c6 about 1 year ago