antoinelouis
commited on
Commit
•
b4fb2d8
1
Parent(s):
9809ed0
Update README.md
Browse files
README.md
CHANGED
@@ -89,11 +89,11 @@ mean reciprocal rank (MRR) and recall at various cut-offs (R@k).
|
|
89 |
| model | #Param.(↓) | Size | Dim. | Index | R@1000 | R@500 | R@100 | R@10 | MRR@10 |
|
90 |
|:-----------------------------------------------------------------------------------------------------------|-----------:|------:|-----:|------:|-------:|------:|------:|-----:|-------:|
|
91 |
| **colbertv2-camembert-L4-mmarcoFR** | 54M | 216MB | 32 | GB | 91.9 | 90.3 | 81.9 | 56.7 | 32.3 |
|
92 |
-
| [FraColBERTv2](bclavie/FraColBERTv2)
|
93 |
-
| [colbertv1-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/colbertv1-camembert-base-mmarcoFR) |
|
94 |
-
| [biencoder-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/biencoder-camembert-base-mmarcoFR) |
|
95 |
|
96 |
-
NB:
|
97 |
|
98 |
***
|
99 |
|
|
|
89 |
| model | #Param.(↓) | Size | Dim. | Index | R@1000 | R@500 | R@100 | R@10 | MRR@10 |
|
90 |
|:-----------------------------------------------------------------------------------------------------------|-----------:|------:|-----:|------:|-------:|------:|------:|-----:|-------:|
|
91 |
| **colbertv2-camembert-L4-mmarcoFR** | 54M | 216MB | 32 | GB | 91.9 | 90.3 | 81.9 | 56.7 | 32.3 |
|
92 |
+
| [FraColBERTv2](https://huggingface.co/bclavie/FraColBERTv2) | 111M | 443MB | 128 | 28GB | | | | | |
|
93 |
+
| [colbertv1-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/colbertv1-camembert-base-mmarcoFR) | 111M | 443MB | 128 | 28GB | 89.7 | 88.4 | 80.0 | 54.2 | 29.5 |
|
94 |
+
| [biencoder-camembert-base-mmarcoFR](https://huggingface.co/antoinelouis/biencoder-camembert-base-mmarcoFR) | 111M | 443MB | 128 | 28GB | - | 89.1 | 77.8 | 51.5 | 28.5 |
|
95 |
|
96 |
+
NB: Index corresponds to the size of the mMARCO-fr index (8.8M passages) on disk when using ColBERTv2's residual compression mechanism.
|
97 |
|
98 |
***
|
99 |
|