README.md

---
license: apache-2.0
datasets:
  - yuyijiong/Long-Instruction-with-Paraphrasing
language:
  - zh
  - en
---

[Qwen2-7B-Instruct](https://huggingface.co/Qwen/Qwen2-7B-Instruct)模型在
[Long-Instruction-with-Paraphrasing](yuyijiong/Long-Instruction-with-Paraphrasing)数据集上微调 1 epoch，提升了
long-context 能力

## Eval on LongBench

long-context 能力得到提升

| dataset              | Qwen2-7B-Instruct     | Qwen2-7b-Instruct-paraph | 
|----------------------|--------|--------------------------|
| hotpotqa             | 42.79  | 49.46                    | 
| dureader             | 24.28  | 33.94                    |
| multifieldqa_en      | 46.17  | 49.65                    | 
| multifieldqa_zh      | 60.64  | 64.53                    | 
| passage_retrieval_en | 70.0   | 84.5                     | 
| passage_retrieval_zh | 56.0   | 70.0                     | 
| trec                 | 76.5   | 76.5                     | 
| lsht                 | 43.5   | 45.0                     | 
| Average              | 52.48 | **59.20**                |