Update README.md
Browse files
README.md
CHANGED
@@ -33,6 +33,7 @@ model = AutoModelForCausalLM.from_pretrained(model_path, device_map="auto", trus
|
|
33 |
|
34 |
input_text="你好。"
|
35 |
response, history = model.chat(tokenizer, input_text, history=None)
|
|
|
36 |
print(response)
|
37 |
```
|
38 |
|
@@ -43,7 +44,7 @@ print(response)
|
|
43 |
### 2.预训练
|
44 |
* 使用[yuyijiong/LongData-Corpus](https://huggingface.co/datasets/yuyijiong/LongData-Corpus)数据,Qlora方法,数据切分为32k文本长度,对Qwen模型进行增量预训练。
|
45 |
### 3.指令微调
|
46 |
-
* 使用[yuyijiong/Long-Instruction-Chinese]https://huggingface.co/datasets/yuyijiong/Long-Instruction-Chinese)数据,Qlora方法,对Qwen模型进行微调。
|
47 |
|
48 |
|
49 |
# 问答例子
|
|
|
33 |
|
34 |
input_text="你好。"
|
35 |
response, history = model.chat(tokenizer, input_text, history=None)
|
36 |
+
|
37 |
print(response)
|
38 |
```
|
39 |
|
|
|
44 |
### 2.预训练
|
45 |
* 使用[yuyijiong/LongData-Corpus](https://huggingface.co/datasets/yuyijiong/LongData-Corpus)数据,Qlora方法,数据切分为32k文本长度,对Qwen模型进行增量预训练。
|
46 |
### 3.指令微调
|
47 |
+
* 使用[yuyijiong/Long-Instruction-Chinese](https://huggingface.co/datasets/yuyijiong/Long-Instruction-Chinese)数据,Qlora方法,对Qwen模型进行微调。
|
48 |
|
49 |
|
50 |
# 问答例子
|