antoinelouis commited on
Commit
c516e21
1 Parent(s): 78311e3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -12
README.md CHANGED
@@ -24,22 +24,16 @@ model-index:
24
  metrics:
25
  - type: recall_at_500
26
  name: Recall@500
27
- value: 0.0
28
  - type: recall_at_100
29
  name: Recall@100
30
- value: 0.0
31
  - type: recall_at_10
32
  name: Recall@10
33
- value: 0.0
34
- - type: map_at_10
35
- name: MAP@10
36
- value: 0.0
37
- - type: ndcg_at_10
38
- name: nDCG@10
39
- value: 0.0
40
  - type: mrr_at_10
41
  name: MRR@10
42
- value: 0.0
43
  ---
44
 
45
  # crossencoder-electra-base-french-mmarcoFR
@@ -107,8 +101,8 @@ print(scores)
107
 
108
  The model is evaluated on the smaller development set of [mMARCO-fr](https://ir-datasets.com/mmarco.html#mmarco/v2/fr/), which consists of 6,980 queries for which
109
  an ensemble of 1000 passages containing the positive(s) and [ColBERTv2 hard negatives](https://huggingface.co/datasets/antoinelouis/msmarco-dev-small-negatives) need
110
- to be reranked. We report the mean reciprocal rank (MRR), normalized discounted cumulative gainand (NDCG), mean average precision (MAP), and recall at various cut-offs
111
- (R@k). To see how it compares to other neural retrievers in French, check out the [*DécouvrIR*](https://huggingface.co/spaces/antoinelouis/decouvrir) leaderboard.
112
 
113
  ***
114
 
 
24
  metrics:
25
  - type: recall_at_500
26
  name: Recall@500
27
+ value: 95.11
28
  - type: recall_at_100
29
  name: Recall@100
30
+ value: 82.72
31
  - type: recall_at_10
32
  name: Recall@10
33
+ value: 56.03
 
 
 
 
 
 
34
  - type: mrr_at_10
35
  name: MRR@10
36
+ value: 31.70
37
  ---
38
 
39
  # crossencoder-electra-base-french-mmarcoFR
 
101
 
102
  The model is evaluated on the smaller development set of [mMARCO-fr](https://ir-datasets.com/mmarco.html#mmarco/v2/fr/), which consists of 6,980 queries for which
103
  an ensemble of 1000 passages containing the positive(s) and [ColBERTv2 hard negatives](https://huggingface.co/datasets/antoinelouis/msmarco-dev-small-negatives) need
104
+ to be reranked. We report the mean reciprocal rank (MRR) and recall at various cut-offs (R@k). To see how it compares to other neural retrievers in French, check out
105
+ the [*DécouvrIR*](https://huggingface.co/spaces/antoinelouis/decouvrir) leaderboard.
106
 
107
  ***
108