frankminors123
commited on
Commit
•
350ca19
1
Parent(s):
062129f
Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ language:
|
|
7 |
# Chinese-CodeLlama-7B-SFT-V2
|
8 |
|
9 |
We added [7k+ python code instructions](https://huggingface.co/datasets/frankminors123/Python-Code-Instructions-7k) and implemented SFT based on our [Chinese-CodeLlama-7B-SFT-V1](https://huggingface.co/frankminors123/Chinese-CodeLlama-7B-SFT-V1). Drawing on the work of [code-llama](https://ai.meta.com/research/publications/code-llama-open-foundation-models-for-code/), we increased
|
10 |
-
the base period of rotary positional embeddings (RoPE) from
|
11 |
|
12 |
The Chinese prompt template used is as follows:
|
13 |
```python
|
|
|
7 |
# Chinese-CodeLlama-7B-SFT-V2
|
8 |
|
9 |
We added [7k+ python code instructions](https://huggingface.co/datasets/frankminors123/Python-Code-Instructions-7k) and implemented SFT based on our [Chinese-CodeLlama-7B-SFT-V1](https://huggingface.co/frankminors123/Chinese-CodeLlama-7B-SFT-V1). Drawing on the work of [code-llama](https://ai.meta.com/research/publications/code-llama-open-foundation-models-for-code/), we increased
|
10 |
+
the base period of rotary positional embeddings (RoPE) from 10000 to 1000000.
|
11 |
|
12 |
The Chinese prompt template used is as follows:
|
13 |
```python
|