Hugging Face's logo

uzabase
/
LLM2Vec-Llama-2-7b-hf-wikipedia-jp-mntp-unsup-simcse

PEFT
Safetensors
Japanese
English
Model card Files Community
h-iida commited on
Commit
8a77cc2
•
1 Parent(s): 6ff07da

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -43,11 +43,17 @@ For the MNTP Adapter, please refer to [this link](https://huggingface.co/uzabase
43
  | | Classification | Clustering | PairClassification | Reranking | BitextMining | Retrieval | STS | AVG |
44
  | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
45
  | Llama2-Llm2vec-eng | 0.527 | 0.258 | 0.501 | 0.217 | 0.275 | 0.296 | 0.765 | 0.408 |
46
- | Llama2-Llm2vec-jpn(This repo) | 0.570 | 0.365 | 0.510 | 0.349 | 0.470 | 0.417 | 0.795 | 0.498 |
47
  | Swallow-Llm2vec-jpn | 0.621 | 0.391 | 0.510 | 0.475 | 0.475 | 0.491 | 0.832 | 0.523 |
48
 
49
  ## MTEB(English)
50
 
 
 
 
 
 
 
51
 
52
  # Training Details
53
 
 
43
  | | Classification | Clustering | PairClassification | Reranking | BitextMining | Retrieval | STS | AVG |
44
  | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
45
  | Llama2-Llm2vec-eng | 0.527 | 0.258 | 0.501 | 0.217 | 0.275 | 0.296 | 0.765 | 0.408 |
46
+ | **Llama2-Llm2vec-jpn (This repo)** | 0.570 | 0.365 | 0.510 | 0.349 | 0.470 | 0.417 | 0.795 | 0.498 |
47
  | Swallow-Llm2vec-jpn | 0.621 | 0.391 | 0.510 | 0.475 | 0.475 | 0.491 | 0.832 | 0.523 |
48
 
49
  ## MTEB(English)
50
 
51
+ | | Classification | Clustering | Pair_Classification| Reranking | Retrieval | STS | 平均 |
52
+ | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
53
+ | Llama2-Llm2vec-eng | 0.709 | 0.386 | 0.780 | 0.588 | 0.329| 0.723 | 0.586 |
54
+ | **Llama2-Llm2vec-jpn (This repo)** | 0.722 | 0.428 | 0.785 | 0.594 | 0.371 | 0.717 | 0.603 |
55
+ | Swallow-Llm2vec-jpn | 0.695 | 0.385 | 0.751 | 0.576 | 0.318 | 0.710 | 0.572 |
56
+
57
 
58
  # Training Details
59