init

.gitattributes

@@ -1,34 +1,36 @@
 *.7z filter=lfs diff=lfs merge=lfs -text
 *.arrow filter=lfs diff=lfs merge=lfs -text
 *.bin filter=lfs diff=lfs merge=lfs -text
-*.bin.* filter=lfs diff=lfs merge=lfs -text
 *.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text
 *.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
 *.model filter=lfs diff=lfs merge=lfs -text
 *.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
 *.onnx filter=lfs diff=lfs merge=lfs -text
 *.ot filter=lfs diff=lfs merge=lfs -text
 *.parquet filter=lfs diff=lfs merge=lfs -text
 *.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
 *.pt filter=lfs diff=lfs merge=lfs -text
 *.pth filter=lfs diff=lfs merge=lfs -text
 *.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
 saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
 *.tflite filter=lfs diff=lfs merge=lfs -text
 *.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
 *.xz filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
-*.zstandard filter=lfs diff=lfs merge=lfs -text
-*.tfevents* filter=lfs diff=lfs merge=lfs -text
-*.db* filter=lfs diff=lfs merge=lfs -text
-*.ark* filter=lfs diff=lfs merge=lfs -text
-**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
-**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
-**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
-*.safetensors filter=lfs diff=lfs merge=lfs -text
-*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,12 +1,58 @@
 ---
-#以下为文本生成的 "tasks"示例，您可以从此网页中了解更多相关信息：https://modelscope.cn/docs/%E4%BB%BB%E5%8A%A1%E7%9A%84%E4%BB%8B%E7%BB%8D
-#tasks:
-#- text-generation
-license: Apache License 2.0
+inference: false
+language:
+  - zh
+license: apache-2.0
+model_creator: ziqingyang
+model_link: https://huggingface.co/ziqingyang/chinese-llama-2-7b
+model_name: chinese-llama-2-7b
+model_type: llama
+pipeline_tag: text-generation
+quantized_by: shaowenchen
+tags:
+  - meta
+  - gguf
+  - llama
+  - llama-2
+  - chinese
 ---
-###### 该模型当前使用的是默认介绍模版，处于“预发布”阶段，页面仅限所有者可见。
-###### 请根据[模型贡献文档说明](https://www.modelscope.cn/docs/%E5%A6%82%E4%BD%95%E6%92%B0%E5%86%99%E5%A5%BD%E7%94%A8%E7%9A%84%E6%A8%A1%E5%9E%8B%E5%8D%A1%E7%89%87)，及时完善模型卡片内容。ModelScope平台将在模型卡片完善后展示。谢谢您的理解。
-#### Clone with HTTP
-```bash
- git clone https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-gguf.git
-```
+
+> English | [中文](README_zh.md)
+
+## Provided files
+
+| Name                                                                                                                                  | Quant method | Size   |
+| ------------------------------------------------------------------------------------------------------------------------------------- | ------------ | ------ |
+| [chinese-llama-2-7b.Q2_K.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q2_K.gguf)     | Q2_K         | 2.7 GB |
+| [chinese-llama-2-7b.Q3_K.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q3_K.gguf)     | Q3_K         | 3.2 GB |
+| [chinese-llama-2-7b.Q3_K_L.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q3_K_L.gguf) | Q3_K_L       | 3.5 GB |
+| [chinese-llama-2-7b.Q3_K_S.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q3_K_S.gguf) | Q3_K_S       | 2.9 GB |
+| [chinese-llama-2-7b.Q4_0.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_0.gguf)     | Q4_0         | 3.7 GB |
+| [chinese-llama-2-7b.Q4_1.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_1.gguf)     | Q4_1         | 4.1 GB |
+| [chinese-llama-2-7b.Q4_K.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_K.gguf)     | Q4_K         | 3.9 GB |
+| [chinese-llama-2-7b.Q4_K_S.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_K_S.gguf) | Q4_K_S       | 3.7 GB |
+| [chinese-llama-2-7b.Q5_0.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_0.gguf)     | Q5_0         | 4.5 GB |
+| [chinese-llama-2-7b.Q5_1.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_1.gguf)     | Q5_1         | 4.9 GB |
+| [chinese-llama-2-7b.Q5_K.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_K.gguf)     | Q5_K         | 4.6 GB |
+| [chinese-llama-2-7b.Q5_K_S.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_K_S.gguf) | Q5_K_S       | 4.5 GB |
+| [chinese-llama-2-7b.Q6_K.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q6_K.gguf)     | Q6_K         | 5.3 GB |
+| [chinese-llama-2-7b.Q8_0.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q8_0.gguf)     | Q8_0         | 6.9 GB |
+| [chinese-llama-2-7b.gguf](https://huggingface.co/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.gguf)               | full         | 13 GB  |
+
+## Provided images
+
+| Name                                                                                                                               | Quant method | Size    |
+| ---------------------------------------------------------------------------------------------------------------------------------- | ------------ | ------- |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q2_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q2_K         | 3.68 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q3_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q3_K         | 4.16 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q3_K_L](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general) | Q3_K_L       | 4.46 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q3_K_S](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general) | Q3_K_S       | 3.81 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q4_0](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q4_0         | 4.7 GB  |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q4_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q4_K         | 4.95 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q4_K_S](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general) | Q4_K_S       | 4.73 GB |
+
+```
+docker run --rm -p 8000:8000 shaowenchen/chinese-llama-2-7b-gguf:Q2_K
+```
+
+and open http://localhost:8000/docs to view the API documentation.

README_zh.md

@@ -0,0 +1,58 @@
+---
+inference: false
+language:
+  - zh
+license: apache-2.0
+model_creator: ziqingyang
+model_link: https://www.modelscope.cn/ziqingyang/chinese-llama-2-7b
+model_name: chinese-llama-2-7b
+model_type: llama
+pipeline_tag: text-generation
+quantized_by: shaowenchen
+tags:
+  - meta
+  - gguf
+  - llama
+  - llama-2
+  - chinese
+---
+
+> [English](README.md) | 中文
+
+## 提供的文件
+
+| 名称                                                                                                                                     | 量化方法 | 大小   |
+| ---------------------------------------------------------------------------------------------------------------------------------------- | -------- | ------ |
+| [chinese-llama-2-7b.Q2_K.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q2_K.gguf)     | Q2_K     | 2.7 GB |
+| [chinese-llama-2-7b.Q3_K.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q3_K.gguf)     | Q3_K     | 3.2 GB |
+| [chinese-llama-2-7b.Q3_K_L.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q3_K_L.gguf) | Q3_K_L   | 3.5 GB |
+| [chinese-llama-2-7b.Q3_K_S.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q3_K_S.gguf) | Q3_K_S   | 2.9 GB |
+| [chinese-llama-2-7b.Q4_0.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_0.gguf)     | Q4_0     | 3.7 GB |
+| [chinese-llama-2-7b.Q4_1.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_1.gguf)     | Q4_1     | 4.1 GB |
+| [chinese-llama-2-7b.Q4_K.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_K.gguf)     | Q4_K     | 3.9 GB |
+| [chinese-llama-2-7b.Q4_K_S.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q4_K_S.gguf) | Q4_K_S   | 3.7 GB |
+| [chinese-llama-2-7b.Q5_0.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_0.gguf)     | Q5_0     | 4.5 GB |
+| [chinese-llama-2-7b.Q5_1.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_1.gguf)     | Q5_1     | 4.9 GB |
+| [chinese-llama-2-7b.Q5_K.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_K.gguf)     | Q5_K     | 4.6 GB |
+| [chinese-llama-2-7b.Q5_K_S.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q5_K_S.gguf) | Q5_K_S   | 4.5 GB |
+| [chinese-llama-2-7b.Q6_K.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q6_K.gguf)     | Q6_K     | 5.3 GB |
+| [chinese-llama-2-7b.Q8_0.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.Q8_0.gguf)     | Q8_0     | 6.9 GB |
+| [chinese-llama-2-7b.gguf](https://www.modelscope.cn/shaowenchen/chinese-llama-2-7b-GGUF/blob/main/chinese-llama-2-7b.gguf)               | 完整     | 13 GB  |
+
+## 提供的镜像
+
+| 名称                                                                                                                               | 量化方法 | 大小    |
+| ---------------------------------------------------------------------------------------------------------------------------------- | -------- | ------- |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q2_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q2_K     | 3.68 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q3_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q3_K     | 4.16 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q3_K_L](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general) | Q3_K_L   | 4.46 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q3_K_S](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general) | Q3_K_S   | 3.81 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q4_0](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q4_0     | 4.7 GB  |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q4_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general)   | Q4_K     | 4.95 GB |
+| [shaowenchen/chinese-llama-2-7b-gguf:Q4_K_S](https://hub.docker.com/repository/docker/shaowenchen/chinese-llama-2-7b-gguf/general) | Q4_K_S   | 4.73 GB |
+
+```
+docker run --rm -p 8000:8000 shaowenchen/chinese-llama-2-7b-gguf:Q2_K
+```
+
+并打开 http://localhost:8000/docs 查看 API 文档。

configuration.json

@@ -0,0 +1,7 @@
+{
+    "framework": "pytorch",
+    "task": "text-generation",
+    "model": {
+        "type": "llama2"
+    }
+}