TheBloke
/

Wizard-Vicuna-30B-Superhot-8K-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Wizard-Vicuna-30B-Superhot-8K-GPTQ

1 contributor

History: 43 commits

TheBloke's picture

Update for Transformers GPTQ support

38d8da7 about 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

12 kB

Update for Transformers GPTQ support about 1 year ago
added_tokens.json

21 Bytes

Initial merged FP16 model commit over 1 year ago
config.json

1.08 kB

Update for Transformers GPTQ support about 1 year ago
generation_config.json

137 Bytes

Initial merged FP16 model commit over 1 year ago
llama_rope_scaled_monkey_patch.py

2.59 kB

Add config.json, Llama modelling code and monkey patch over 1 year ago
model.safetensors

16.9 GB
LFS

Update for Transformers GPTQ support about 1 year ago
modelling_llama.py

39.5 kB

Add config.json, Llama modelling code and monkey patch over 1 year ago
quantize_config.json

156 Bytes

Update for Transformers GPTQ support about 1 year ago
special_tokens_map.json

435 Bytes

Initial merged FP16 model commit over 1 year ago
tokenizer.json

1.84 MB

Initial merged FP16 model commit over 1 year ago
tokenizer.model

500 kB
LFS

Initial merged FP16 model commit over 1 year ago
tokenizer_config.json

727 Bytes

Initial merged FP16 model commit over 1 year ago