antoinelouis
commited on
Commit
•
c516e21
1
Parent(s):
78311e3
Update README.md
Browse files
README.md
CHANGED
@@ -24,22 +24,16 @@ model-index:
|
|
24 |
metrics:
|
25 |
- type: recall_at_500
|
26 |
name: Recall@500
|
27 |
-
value:
|
28 |
- type: recall_at_100
|
29 |
name: Recall@100
|
30 |
-
value:
|
31 |
- type: recall_at_10
|
32 |
name: Recall@10
|
33 |
-
value:
|
34 |
-
- type: map_at_10
|
35 |
-
name: MAP@10
|
36 |
-
value: 0.0
|
37 |
-
- type: ndcg_at_10
|
38 |
-
name: nDCG@10
|
39 |
-
value: 0.0
|
40 |
- type: mrr_at_10
|
41 |
name: MRR@10
|
42 |
-
value:
|
43 |
---
|
44 |
|
45 |
# crossencoder-electra-base-french-mmarcoFR
|
@@ -107,8 +101,8 @@ print(scores)
|
|
107 |
|
108 |
The model is evaluated on the smaller development set of [mMARCO-fr](https://ir-datasets.com/mmarco.html#mmarco/v2/fr/), which consists of 6,980 queries for which
|
109 |
an ensemble of 1000 passages containing the positive(s) and [ColBERTv2 hard negatives](https://huggingface.co/datasets/antoinelouis/msmarco-dev-small-negatives) need
|
110 |
-
to be reranked. We report the mean reciprocal rank (MRR)
|
111 |
-
|
112 |
|
113 |
***
|
114 |
|
|
|
24 |
metrics:
|
25 |
- type: recall_at_500
|
26 |
name: Recall@500
|
27 |
+
value: 95.11
|
28 |
- type: recall_at_100
|
29 |
name: Recall@100
|
30 |
+
value: 82.72
|
31 |
- type: recall_at_10
|
32 |
name: Recall@10
|
33 |
+
value: 56.03
|
|
|
|
|
|
|
|
|
|
|
|
|
34 |
- type: mrr_at_10
|
35 |
name: MRR@10
|
36 |
+
value: 31.70
|
37 |
---
|
38 |
|
39 |
# crossencoder-electra-base-french-mmarcoFR
|
|
|
101 |
|
102 |
The model is evaluated on the smaller development set of [mMARCO-fr](https://ir-datasets.com/mmarco.html#mmarco/v2/fr/), which consists of 6,980 queries for which
|
103 |
an ensemble of 1000 passages containing the positive(s) and [ColBERTv2 hard negatives](https://huggingface.co/datasets/antoinelouis/msmarco-dev-small-negatives) need
|
104 |
+
to be reranked. We report the mean reciprocal rank (MRR) and recall at various cut-offs (R@k). To see how it compares to other neural retrievers in French, check out
|
105 |
+
the [*DécouvrIR*](https://huggingface.co/spaces/antoinelouis/decouvrir) leaderboard.
|
106 |
|
107 |
***
|
108 |
|