Alibaba-NLP
/

gte-Qwen2-1.5B-instruct

用eval_mteb.py算出来的mteb指标和Leaderboard展示的差距很大，不清楚为什么？

#16

by YangGuang30 - opened Oct 11

Oct 11

•

只算了中文的retrievel任务MMarcoRetrieval: 0.4945
DuRetrieval: 0.38997

Oct 13

可能是你没有加Instruction到query前面

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment