
The models can be loaded by the [InferLLM](https://github.com/MegEngine/InferLLM) project.

Chinese Alpaca model is from https://github.com/ymcui/Chinese-LLaMA-Alpaca

ggml Alpaca model is from https://huggingface.co/Sosaka/Alpaca-native-4bit-ggml/tree/main

the two models also can be loaded by the [llama.cpp](https://github.com/ggerganov/llama.cpp) project.

InferLLM support the ChatGLM/ChatGLM2 model, the chatglm-q4/bin/chatglm2-q4.bin is the int4 quantized model from [chatglm-6b](https://huggingface.co/THUDM/chatglm-6b)/[chatglm2-6b](https://huggingface.co/THUDM/chatglm2-6b) 

InferLLM support the baichuan model, the baichuan-q4 is the int4 quantized model from [baichuan](https://huggingface.co/fireballoon/baichuan-vicuna-7b) 

InferLLM support the llama2 model, the llama2-q4 is the int4 quantized model from [llama2](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) 

{"license": "apache-2.0"}
license:apache-2.0 region:us
TAGS
#license-apache-2.0 #region-us 


The models can be loaded by the InferLLM project.

Chinese Alpaca model is from URL

ggml Alpaca model is from URL

the two models also can be loaded by the URL project.

InferLLM support the ChatGLM/ChatGLM2 model, the chatglm-q4/bin/URL is the int4 quantized model from chatglm-6b/chatglm2-6b 

InferLLM support the baichuan model, the baichuan-q4 is the int4 quantized model from baichuan 

InferLLM support the llama2 model, the llama2-q4 is the int4 quantized model from llama2 

TAGS
#license-apache-2.0 #region-us 
