Edit model card

Qwen2-7B-Instruct模型在 Long-Instruction-with-Paraphrasing数据集上微调 1 epoch,提升了 long-context 能力

Eval on LongBench

long-context 能力得到提升

dataset Qwen2-7B-Instruct Qwen2-7b-Instruct-paraph
hotpotqa 42.79 49.46
dureader 24.28 33.94
multifieldqa_en 46.17 49.65
multifieldqa_zh 60.64 64.53
passage_retrieval_en 70.0 84.5
passage_retrieval_zh 56.0 70.0
trec 76.5 76.5
lsht 43.5 45.0
Average 52.48 59.20
Downloads last month
9
Safetensors
Model size
7.62B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train yuyijiong/Qwen2-7b-Instruct-paraph

Collection including yuyijiong/Qwen2-7b-Instruct-paraph