metadata
license: apache-2.0
language:
- zh
- en
library_name: transformers
pipeline_tag: text-generation
原始模型：https://huggingface.co/TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
lora：https://huggingface.co/ziqingyang/chinese-alpaca-lora-13b
使用项目： https://github.com/ymcui/Chinese-LLaMA-Alpaca
https://github.com/qwopqwop200/GPTQ-for-LLaMa
兼容AutoGPTQ和GPTQ-for-LLaMa
若选择GPTQ-for-LLaMa加载，请设置 Wbits=4 groupsize=128 model_type=llama
Compatible with AutoGPTQ and GPTQ-for-LLaMa
If selecting GPTQ-for-LLaMa loading, please set Wbits=4 groupsize=128 model_type=llama
Text-generation-webui懒人包： https://www.bilibili.com/read/cv23495183