zeroshot commited on
Commit
db1c6c7
1 Parent(s): fca2fe8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1020 -32
README.md CHANGED
@@ -117,53 +117,925 @@ model-index:
117
  value: 59.744
118
  - type: recall_at_5
119
  value: 70.626
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
120
  - task:
121
  type: Reranking
122
  dataset:
123
- type: mteb/askubuntudupquestions-reranking
124
- name: MTEB AskUbuntuDupQuestions
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
125
  config: default
126
  split: test
127
- revision: 2000358ca161889fa9c082cb41daa8dcfb161a54
128
  metrics:
129
- - type: map
130
- value: 62.40334669601722
131
- - type: mrr
132
- value: 75.33175042870333
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
133
  - task:
134
- type: STS
135
  dataset:
136
- type: mteb/biosses-sts
137
- name: MTEB BIOSSES
138
  config: default
139
  split: test
140
- revision: d3fb88f8f02e40887cd149695127462bbcf29b4a
141
  metrics:
142
- - type: cos_sim_pearson
143
- value: 88.00433892980047
144
- - type: cos_sim_spearman
145
- value: 86.65558896421105
146
- - type: euclidean_pearson
147
- value: 85.98927300398377
148
- - type: euclidean_spearman
149
- value: 86.0905158476729
150
- - type: manhattan_pearson
151
- value: 86.0272425017433
152
- - type: manhattan_spearman
153
- value: 85.8929209838941
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
154
  - task:
155
- type: Classification
156
  dataset:
157
- type: mteb/banking77
158
- name: MTEB Banking77Classification
159
  config: default
160
  split: test
161
- revision: 0fd18e25b25c072e09e0d92ab615fda904d66300
162
  metrics:
163
- - type: accuracy
164
- value: 85.1038961038961
165
- - type: f1
166
- value: 85.06851570045757
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
167
  - task:
168
  type: Classification
169
  dataset:
@@ -244,6 +1116,63 @@ model-index:
244
  value: 77.95897780766644
245
  - type: f1
246
  value: 77.80380046125542
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
247
  - task:
248
  type: STS
249
  dataset:
@@ -433,6 +1362,19 @@ model-index:
433
  value: 86.2546330637872
434
  - type: manhattan_spearman
435
  value: 86.46309860938591
 
 
 
 
 
 
 
 
 
 
 
 
 
436
  - task:
437
  type: PairClassification
438
  dataset:
@@ -471,7 +1413,7 @@ model-index:
471
  - type: euclidean_precision
472
  value: 94.04388714733543
473
  - type: euclidean_recall
474
- value: 90
475
  - type: manhattan_accuracy
476
  value: 99.84158415841584
477
  - type: manhattan_ap
@@ -488,6 +1430,41 @@ model-index:
488
  value: 96.25445889914926
489
  - type: max_f1
490
  value: 92.03805708562844
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
491
  - task:
492
  type: Classification
493
  dataset:
@@ -516,6 +1493,17 @@ model-index:
516
  value: 60.01980758347483
517
  - type: f1
518
  value: 60.35679678249753
 
 
 
 
 
 
 
 
 
 
 
519
  - task:
520
  type: PairClassification
521
  dataset:
 
117
  value: 59.744
118
  - type: recall_at_5
119
  value: 70.626
120
+ - task:
121
+ type: Clustering
122
+ dataset:
123
+ type: mteb/arxiv-clustering-p2p
124
+ name: MTEB ArxivClusteringP2P
125
+ config: default
126
+ split: test
127
+ revision: a122ad7f3f0291bf49cc6f4d32aa80929df69d5d
128
+ metrics:
129
+ - type: v_measure
130
+ value: 46.91874634333147
131
+ - task:
132
+ type: Clustering
133
+ dataset:
134
+ type: mteb/arxiv-clustering-s2s
135
+ name: MTEB ArxivClusteringS2S
136
+ config: default
137
+ split: test
138
+ revision: f910caf1a6075f7329cdf8c1a6135696f37dbd53
139
+ metrics:
140
+ - type: v_measure
141
+ value: 39.1201020016146
142
  - task:
143
  type: Reranking
144
  dataset:
145
+ type: mteb/askubuntudupquestions-reranking
146
+ name: MTEB AskUbuntuDupQuestions
147
+ config: default
148
+ split: test
149
+ revision: 2000358ca161889fa9c082cb41daa8dcfb161a54
150
+ metrics:
151
+ - type: map
152
+ value: 62.40334669601722
153
+ - type: mrr
154
+ value: 75.33175042870333
155
+ - task:
156
+ type: STS
157
+ dataset:
158
+ type: mteb/biosses-sts
159
+ name: MTEB BIOSSES
160
+ config: default
161
+ split: test
162
+ revision: d3fb88f8f02e40887cd149695127462bbcf29b4a
163
+ metrics:
164
+ - type: cos_sim_pearson
165
+ value: 88.00433892980047
166
+ - type: cos_sim_spearman
167
+ value: 86.65558896421105
168
+ - type: euclidean_pearson
169
+ value: 85.98927300398377
170
+ - type: euclidean_spearman
171
+ value: 86.0905158476729
172
+ - type: manhattan_pearson
173
+ value: 86.0272425017433
174
+ - type: manhattan_spearman
175
+ value: 85.8929209838941
176
+ - task:
177
+ type: Classification
178
+ dataset:
179
+ type: mteb/banking77
180
+ name: MTEB Banking77Classification
181
+ config: default
182
+ split: test
183
+ revision: 0fd18e25b25c072e09e0d92ab615fda904d66300
184
+ metrics:
185
+ - type: accuracy
186
+ value: 85.1038961038961
187
+ - type: f1
188
+ value: 85.06851570045757
189
+ - task:
190
+ type: Clustering
191
+ dataset:
192
+ type: mteb/biorxiv-clustering-p2p
193
+ name: MTEB BiorxivClusteringP2P
194
+ config: default
195
+ split: test
196
+ revision: 65b79d1d13f80053f67aca9498d9402c2d9f1f40
197
+ metrics:
198
+ - type: v_measure
199
+ value: 37.42637694389153
200
+ - task:
201
+ type: Clustering
202
+ dataset:
203
+ type: mteb/biorxiv-clustering-s2s
204
+ name: MTEB BiorxivClusteringS2S
205
+ config: default
206
+ split: test
207
+ revision: 258694dd0231531bc1fd9de6ceb52a0853c6d908
208
+ metrics:
209
+ - type: v_measure
210
+ value: 33.89440321125906
211
+ - task:
212
+ type: Retrieval
213
+ dataset:
214
+ type: BeIR/cqadupstack
215
+ name: MTEB CQADupstackAndroidRetrieval
216
+ config: default
217
+ split: test
218
+ revision: None
219
+ metrics:
220
+ - type: map_at_1
221
+ value: 28.111000000000004
222
+ - type: map_at_10
223
+ value: 39.067
224
+ - type: map_at_100
225
+ value: 40.519
226
+ - type: map_at_1000
227
+ value: 40.652
228
+ - type: map_at_3
229
+ value: 35.571999999999996
230
+ - type: map_at_5
231
+ value: 37.708999999999996
232
+ - type: mrr_at_1
233
+ value: 34.335
234
+ - type: mrr_at_10
235
+ value: 44.868
236
+ - type: mrr_at_100
237
+ value: 45.607
238
+ - type: mrr_at_1000
239
+ value: 45.655
240
+ - type: mrr_at_3
241
+ value: 41.798
242
+ - type: mrr_at_5
243
+ value: 43.786
244
+ - type: ndcg_at_1
245
+ value: 34.335
246
+ - type: ndcg_at_10
247
+ value: 45.513
248
+ - type: ndcg_at_100
249
+ value: 51.037
250
+ - type: ndcg_at_1000
251
+ value: 53.171
252
+ - type: ndcg_at_3
253
+ value: 40.131
254
+ - type: ndcg_at_5
255
+ value: 43.027
256
+ - type: precision_at_1
257
+ value: 34.335
258
+ - type: precision_at_10
259
+ value: 8.784
260
+ - type: precision_at_100
261
+ value: 1.4460000000000002
262
+ - type: precision_at_1000
263
+ value: 0.193
264
+ - type: precision_at_3
265
+ value: 19.361
266
+ - type: precision_at_5
267
+ value: 14.249
268
+ - type: recall_at_1
269
+ value: 28.111000000000004
270
+ - type: recall_at_10
271
+ value: 58.372
272
+ - type: recall_at_100
273
+ value: 81.631
274
+ - type: recall_at_1000
275
+ value: 95.192
276
+ - type: recall_at_3
277
+ value: 42.863
278
+ - type: recall_at_5
279
+ value: 50.924
280
+ - task:
281
+ type: Retrieval
282
+ dataset:
283
+ type: BeIR/cqadupstack
284
+ name: MTEB CQADupstackEnglishRetrieval
285
+ config: default
286
+ split: test
287
+ revision: None
288
+ metrics:
289
+ - type: map_at_1
290
+ value: 28.437
291
+ - type: map_at_10
292
+ value: 37.942
293
+ - type: map_at_100
294
+ value: 39.108
295
+ - type: map_at_1000
296
+ value: 39.242
297
+ - type: map_at_3
298
+ value: 35.419
299
+ - type: map_at_5
300
+ value: 36.825
301
+ - type: mrr_at_1
302
+ value: 35.35
303
+ - type: mrr_at_10
304
+ value: 43.855
305
+ - type: mrr_at_100
306
+ value: 44.543
307
+ - type: mrr_at_1000
308
+ value: 44.588
309
+ - type: mrr_at_3
310
+ value: 41.826
311
+ - type: mrr_at_5
312
+ value: 42.937
313
+ - type: ndcg_at_1
314
+ value: 35.35
315
+ - type: ndcg_at_10
316
+ value: 43.32
317
+ - type: ndcg_at_100
318
+ value: 47.769
319
+ - type: ndcg_at_1000
320
+ value: 49.979
321
+ - type: ndcg_at_3
322
+ value: 39.709
323
+ - type: ndcg_at_5
324
+ value: 41.316
325
+ - type: precision_at_1
326
+ value: 35.35
327
+ - type: precision_at_10
328
+ value: 7.994
329
+ - type: precision_at_100
330
+ value: 1.323
331
+ - type: precision_at_1000
332
+ value: 0.182
333
+ - type: precision_at_3
334
+ value: 18.96
335
+ - type: precision_at_5
336
+ value: 13.236
337
+ - type: recall_at_1
338
+ value: 28.437
339
+ - type: recall_at_10
340
+ value: 52.531000000000006
341
+ - type: recall_at_100
342
+ value: 71.79299999999999
343
+ - type: recall_at_1000
344
+ value: 85.675
345
+ - type: recall_at_3
346
+ value: 41.605
347
+ - type: recall_at_5
348
+ value: 46.32
349
+ - task:
350
+ type: Retrieval
351
+ dataset:
352
+ type: BeIR/cqadupstack
353
+ name: MTEB CQADupstackGamingRetrieval
354
+ config: default
355
+ split: test
356
+ revision: None
357
+ metrics:
358
+ - type: map_at_1
359
+ value: 37.364999999999995
360
+ - type: map_at_10
361
+ value: 49.324
362
+ - type: map_at_100
363
+ value: 50.458999999999996
364
+ - type: map_at_1000
365
+ value: 50.512
366
+ - type: map_at_3
367
+ value: 45.96
368
+ - type: map_at_5
369
+ value: 47.934
370
+ - type: mrr_at_1
371
+ value: 43.009
372
+ - type: mrr_at_10
373
+ value: 52.946000000000005
374
+ - type: mrr_at_100
375
+ value: 53.74100000000001
376
+ - type: mrr_at_1000
377
+ value: 53.76800000000001
378
+ - type: mrr_at_3
379
+ value: 50.554
380
+ - type: mrr_at_5
381
+ value: 51.964
382
+ - type: ndcg_at_1
383
+ value: 43.009
384
+ - type: ndcg_at_10
385
+ value: 55.143
386
+ - type: ndcg_at_100
387
+ value: 59.653999999999996
388
+ - type: ndcg_at_1000
389
+ value: 60.805
390
+ - type: ndcg_at_3
391
+ value: 49.605
392
+ - type: ndcg_at_5
393
+ value: 52.437
394
+ - type: precision_at_1
395
+ value: 43.009
396
+ - type: precision_at_10
397
+ value: 8.984
398
+ - type: precision_at_100
399
+ value: 1.209
400
+ - type: precision_at_1000
401
+ value: 0.135
402
+ - type: precision_at_3
403
+ value: 22.09
404
+ - type: precision_at_5
405
+ value: 15.423
406
+ - type: recall_at_1
407
+ value: 37.364999999999995
408
+ - type: recall_at_10
409
+ value: 68.657
410
+ - type: recall_at_100
411
+ value: 88.155
412
+ - type: recall_at_1000
413
+ value: 96.48400000000001
414
+ - type: recall_at_3
415
+ value: 54.186
416
+ - type: recall_at_5
417
+ value: 60.848
418
+ - task:
419
+ type: Retrieval
420
+ dataset:
421
+ type: BeIR/cqadupstack
422
+ name: MTEB CQADupstackGisRetrieval
423
+ config: default
424
+ split: test
425
+ revision: None
426
+ metrics:
427
+ - type: map_at_1
428
+ value: 23.827
429
+ - type: map_at_10
430
+ value: 31.721
431
+ - type: map_at_100
432
+ value: 32.812999999999995
433
+ - type: map_at_1000
434
+ value: 32.89
435
+ - type: map_at_3
436
+ value: 29.238999999999997
437
+ - type: map_at_5
438
+ value: 30.584
439
+ - type: mrr_at_1
440
+ value: 25.650000000000002
441
+ - type: mrr_at_10
442
+ value: 33.642
443
+ - type: mrr_at_100
444
+ value: 34.595
445
+ - type: mrr_at_1000
446
+ value: 34.650999999999996
447
+ - type: mrr_at_3
448
+ value: 31.205
449
+ - type: mrr_at_5
450
+ value: 32.499
451
+ - type: ndcg_at_1
452
+ value: 25.650000000000002
453
+ - type: ndcg_at_10
454
+ value: 36.366
455
+ - type: ndcg_at_100
456
+ value: 41.766
457
+ - type: ndcg_at_1000
458
+ value: 43.735
459
+ - type: ndcg_at_3
460
+ value: 31.447000000000003
461
+ - type: ndcg_at_5
462
+ value: 33.701
463
+ - type: precision_at_1
464
+ value: 25.650000000000002
465
+ - type: precision_at_10
466
+ value: 5.582
467
+ - type: precision_at_100
468
+ value: 0.872
469
+ - type: precision_at_1000
470
+ value: 0.108
471
+ - type: precision_at_3
472
+ value: 13.107
473
+ - type: precision_at_5
474
+ value: 9.198
475
+ - type: recall_at_1
476
+ value: 23.827
477
+ - type: recall_at_10
478
+ value: 48.9
479
+ - type: recall_at_100
480
+ value: 73.917
481
+ - type: recall_at_1000
482
+ value: 88.787
483
+ - type: recall_at_3
484
+ value: 35.498000000000005
485
+ - type: recall_at_5
486
+ value: 40.929
487
+ - task:
488
+ type: Retrieval
489
+ dataset:
490
+ type: BeIR/cqadupstack
491
+ name: MTEB CQADupstackMathematicaRetrieval
492
+ config: default
493
+ split: test
494
+ revision: None
495
+ metrics:
496
+ - type: map_at_1
497
+ value: 15.47
498
+ - type: map_at_10
499
+ value: 22.679
500
+ - type: map_at_100
501
+ value: 23.823
502
+ - type: map_at_1000
503
+ value: 23.94
504
+ - type: map_at_3
505
+ value: 20.535999999999998
506
+ - type: map_at_5
507
+ value: 21.61
508
+ - type: mrr_at_1
509
+ value: 18.781
510
+ - type: mrr_at_10
511
+ value: 26.979
512
+ - type: mrr_at_100
513
+ value: 27.945999999999998
514
+ - type: mrr_at_1000
515
+ value: 28.016000000000002
516
+ - type: mrr_at_3
517
+ value: 24.648
518
+ - type: mrr_at_5
519
+ value: 25.947
520
+ - type: ndcg_at_1
521
+ value: 18.781
522
+ - type: ndcg_at_10
523
+ value: 27.55
524
+ - type: ndcg_at_100
525
+ value: 33.176
526
+ - type: ndcg_at_1000
527
+ value: 36.150999999999996
528
+ - type: ndcg_at_3
529
+ value: 23.456
530
+ - type: ndcg_at_5
531
+ value: 25.16
532
+ - type: precision_at_1
533
+ value: 18.781
534
+ - type: precision_at_10
535
+ value: 5.050000000000001
536
+ - type: precision_at_100
537
+ value: 0.9039999999999999
538
+ - type: precision_at_1000
539
+ value: 0.129
540
+ - type: precision_at_3
541
+ value: 11.235000000000001
542
+ - type: precision_at_5
543
+ value: 8.01
544
+ - type: recall_at_1
545
+ value: 15.47
546
+ - type: recall_at_10
547
+ value: 38.446000000000005
548
+ - type: recall_at_100
549
+ value: 63.199000000000005
550
+ - type: recall_at_1000
551
+ value: 84.719
552
+ - type: recall_at_3
553
+ value: 26.687
554
+ - type: recall_at_5
555
+ value: 31.196
556
+ - task:
557
+ type: Retrieval
558
+ dataset:
559
+ type: BeIR/cqadupstack
560
+ name: MTEB CQADupstackPhysicsRetrieval
561
+ config: default
562
+ split: test
563
+ revision: None
564
+ metrics:
565
+ - type: map_at_1
566
+ value: 26.285999999999998
567
+ - type: map_at_10
568
+ value: 35.701
569
+ - type: map_at_100
570
+ value: 37.062
571
+ - type: map_at_1000
572
+ value: 37.175999999999995
573
+ - type: map_at_3
574
+ value: 32.65
575
+ - type: map_at_5
576
+ value: 34.129
577
+ - type: mrr_at_1
578
+ value: 32.05
579
+ - type: mrr_at_10
580
+ value: 41.105000000000004
581
+ - type: mrr_at_100
582
+ value: 41.996
583
+ - type: mrr_at_1000
584
+ value: 42.047000000000004
585
+ - type: mrr_at_3
586
+ value: 38.466
587
+ - type: mrr_at_5
588
+ value: 39.766
589
+ - type: ndcg_at_1
590
+ value: 32.05
591
+ - type: ndcg_at_10
592
+ value: 41.516999999999996
593
+ - type: ndcg_at_100
594
+ value: 47.083999999999996
595
+ - type: ndcg_at_1000
596
+ value: 49.309
597
+ - type: ndcg_at_3
598
+ value: 36.254999999999995
599
+ - type: ndcg_at_5
600
+ value: 38.346999999999994
601
+ - type: precision_at_1
602
+ value: 32.05
603
+ - type: precision_at_10
604
+ value: 7.536
605
+ - type: precision_at_100
606
+ value: 1.202
607
+ - type: precision_at_1000
608
+ value: 0.158
609
+ - type: precision_at_3
610
+ value: 17.004
611
+ - type: precision_at_5
612
+ value: 11.973
613
+ - type: recall_at_1
614
+ value: 26.285999999999998
615
+ - type: recall_at_10
616
+ value: 53.667
617
+ - type: recall_at_100
618
+ value: 76.97
619
+ - type: recall_at_1000
620
+ value: 91.691
621
+ - type: recall_at_3
622
+ value: 38.571
623
+ - type: recall_at_5
624
+ value: 44.131
625
+ - task:
626
+ type: Retrieval
627
+ dataset:
628
+ type: BeIR/cqadupstack
629
+ name: MTEB CQADupstackProgrammersRetrieval
630
+ config: default
631
+ split: test
632
+ revision: None
633
+ metrics:
634
+ - type: map_at_1
635
+ value: 22.595000000000002
636
+ - type: map_at_10
637
+ value: 31.352000000000004
638
+ - type: map_at_100
639
+ value: 32.652
640
+ - type: map_at_1000
641
+ value: 32.774
642
+ - type: map_at_3
643
+ value: 28.238000000000003
644
+ - type: map_at_5
645
+ value: 30.178
646
+ - type: mrr_at_1
647
+ value: 27.626
648
+ - type: mrr_at_10
649
+ value: 36.351
650
+ - type: mrr_at_100
651
+ value: 37.297000000000004
652
+ - type: mrr_at_1000
653
+ value: 37.362
654
+ - type: mrr_at_3
655
+ value: 33.885
656
+ - type: mrr_at_5
657
+ value: 35.358000000000004
658
+ - type: ndcg_at_1
659
+ value: 27.626
660
+ - type: ndcg_at_10
661
+ value: 36.795
662
+ - type: ndcg_at_100
663
+ value: 42.808
664
+ - type: ndcg_at_1000
665
+ value: 45.417
666
+ - type: ndcg_at_3
667
+ value: 31.744
668
+ - type: ndcg_at_5
669
+ value: 34.407
670
+ - type: precision_at_1
671
+ value: 27.626
672
+ - type: precision_at_10
673
+ value: 6.781
674
+ - type: precision_at_100
675
+ value: 1.159
676
+ - type: precision_at_1000
677
+ value: 0.155
678
+ - type: precision_at_3
679
+ value: 15.221000000000002
680
+ - type: precision_at_5
681
+ value: 11.279
682
+ - type: recall_at_1
683
+ value: 22.595000000000002
684
+ - type: recall_at_10
685
+ value: 48.126000000000005
686
+ - type: recall_at_100
687
+ value: 74.24300000000001
688
+ - type: recall_at_1000
689
+ value: 92.276
690
+ - type: recall_at_3
691
+ value: 34.346
692
+ - type: recall_at_5
693
+ value: 41.065000000000005
694
+ - task:
695
+ type: Retrieval
696
+ dataset:
697
+ type: BeIR/cqadupstack
698
+ name: MTEB CQADupstackStatsRetrieval
699
+ config: default
700
+ split: test
701
+ revision: None
702
+ metrics:
703
+ - type: map_at_1
704
+ value: 22.237000000000002
705
+ - type: map_at_10
706
+ value: 28.626
707
+ - type: map_at_100
708
+ value: 29.494999999999997
709
+ - type: map_at_1000
710
+ value: 29.587999999999997
711
+ - type: map_at_3
712
+ value: 26.747
713
+ - type: map_at_5
714
+ value: 27.903
715
+ - type: mrr_at_1
716
+ value: 24.847
717
+ - type: mrr_at_10
718
+ value: 31.091
719
+ - type: mrr_at_100
720
+ value: 31.91
721
+ - type: mrr_at_1000
722
+ value: 31.977
723
+ - type: mrr_at_3
724
+ value: 29.218
725
+ - type: mrr_at_5
726
+ value: 30.391000000000002
727
+ - type: ndcg_at_1
728
+ value: 24.847
729
+ - type: ndcg_at_10
730
+ value: 32.452999999999996
731
+ - type: ndcg_at_100
732
+ value: 37.009
733
+ - type: ndcg_at_1000
734
+ value: 39.425
735
+ - type: ndcg_at_3
736
+ value: 28.848000000000003
737
+ - type: ndcg_at_5
738
+ value: 30.752000000000002
739
+ - type: precision_at_1
740
+ value: 24.847
741
+ - type: precision_at_10
742
+ value: 4.968999999999999
743
+ - type: precision_at_100
744
+ value: 0.8009999999999999
745
+ - type: precision_at_1000
746
+ value: 0.107
747
+ - type: precision_at_3
748
+ value: 12.321
749
+ - type: precision_at_5
750
+ value: 8.62
751
+ - type: recall_at_1
752
+ value: 22.237000000000002
753
+ - type: recall_at_10
754
+ value: 41.942
755
+ - type: recall_at_100
756
+ value: 62.907000000000004
757
+ - type: recall_at_1000
758
+ value: 81.035
759
+ - type: recall_at_3
760
+ value: 32.05
761
+ - type: recall_at_5
762
+ value: 36.695
763
+ - task:
764
+ type: Retrieval
765
+ dataset:
766
+ type: BeIR/cqadupstack
767
+ name: MTEB CQADupstackTexRetrieval
768
  config: default
769
  split: test
770
+ revision: None
771
  metrics:
772
+ - type: map_at_1
773
+ value: 14.835
774
+ - type: map_at_10
775
+ value: 21.124000000000002
776
+ - type: map_at_100
777
+ value: 22.133
778
+ - type: map_at_1000
779
+ value: 22.258
780
+ - type: map_at_3
781
+ value: 19.076999999999998
782
+ - type: map_at_5
783
+ value: 20.18
784
+ - type: mrr_at_1
785
+ value: 17.791
786
+ - type: mrr_at_10
787
+ value: 24.438
788
+ - type: mrr_at_100
789
+ value: 25.332
790
+ - type: mrr_at_1000
791
+ value: 25.417
792
+ - type: mrr_at_3
793
+ value: 22.425
794
+ - type: mrr_at_5
795
+ value: 23.524
796
+ - type: ndcg_at_1
797
+ value: 17.791
798
+ - type: ndcg_at_10
799
+ value: 25.27
800
+ - type: ndcg_at_100
801
+ value: 30.362000000000002
802
+ - type: ndcg_at_1000
803
+ value: 33.494
804
+ - type: ndcg_at_3
805
+ value: 21.474
806
+ - type: ndcg_at_5
807
+ value: 23.189999999999998
808
+ - type: precision_at_1
809
+ value: 17.791
810
+ - type: precision_at_10
811
+ value: 4.58
812
+ - type: precision_at_100
813
+ value: 0.839
814
+ - type: precision_at_1000
815
+ value: 0.128
816
+ - type: precision_at_3
817
+ value: 10.071
818
+ - type: precision_at_5
819
+ value: 7.337000000000001
820
+ - type: recall_at_1
821
+ value: 14.835
822
+ - type: recall_at_10
823
+ value: 34.534
824
+ - type: recall_at_100
825
+ value: 57.812
826
+ - type: recall_at_1000
827
+ value: 80.467
828
+ - type: recall_at_3
829
+ value: 23.938000000000002
830
+ - type: recall_at_5
831
+ value: 28.269
832
  - task:
833
+ type: Retrieval
834
  dataset:
835
+ type: BeIR/cqadupstack
836
+ name: MTEB CQADupstackUnixRetrieval
837
  config: default
838
  split: test
839
+ revision: None
840
  metrics:
841
+ - type: map_at_1
842
+ value: 23.400000000000002
843
+ - type: map_at_10
844
+ value: 31.55
845
+ - type: map_at_100
846
+ value: 32.72
847
+ - type: map_at_1000
848
+ value: 32.830999999999996
849
+ - type: map_at_3
850
+ value: 28.942
851
+ - type: map_at_5
852
+ value: 30.403000000000002
853
+ - type: mrr_at_1
854
+ value: 27.705000000000002
855
+ - type: mrr_at_10
856
+ value: 35.778
857
+ - type: mrr_at_100
858
+ value: 36.705
859
+ - type: mrr_at_1000
860
+ value: 36.773
861
+ - type: mrr_at_3
862
+ value: 33.458
863
+ - type: mrr_at_5
864
+ value: 34.778
865
+ - type: ndcg_at_1
866
+ value: 27.705000000000002
867
+ - type: ndcg_at_10
868
+ value: 36.541000000000004
869
+ - type: ndcg_at_100
870
+ value: 42.016999999999996
871
+ - type: ndcg_at_1000
872
+ value: 44.571
873
+ - type: ndcg_at_3
874
+ value: 31.845000000000002
875
+ - type: ndcg_at_5
876
+ value: 34.056
877
+ - type: precision_at_1
878
+ value: 27.705000000000002
879
+ - type: precision_at_10
880
+ value: 6.166
881
+ - type: precision_at_100
882
+ value: 0.993
883
+ - type: precision_at_1000
884
+ value: 0.132
885
+ - type: precision_at_3
886
+ value: 14.302999999999999
887
+ - type: precision_at_5
888
+ value: 10.187
889
+ - type: recall_at_1
890
+ value: 23.400000000000002
891
+ - type: recall_at_10
892
+ value: 47.61
893
+ - type: recall_at_100
894
+ value: 71.69200000000001
895
+ - type: recall_at_1000
896
+ value: 89.652
897
+ - type: recall_at_3
898
+ value: 35.026
899
+ - type: recall_at_5
900
+ value: 40.48
901
  - task:
902
+ type: Retrieval
903
  dataset:
904
+ type: BeIR/cqadupstack
905
+ name: MTEB CQADupstackWebmastersRetrieval
906
  config: default
907
  split: test
908
+ revision: None
909
  metrics:
910
+ - type: map_at_1
911
+ value: 21.409
912
+ - type: map_at_10
913
+ value: 29.642000000000003
914
+ - type: map_at_100
915
+ value: 31.213
916
+ - type: map_at_1000
917
+ value: 31.418000000000003
918
+ - type: map_at_3
919
+ value: 26.811
920
+ - type: map_at_5
921
+ value: 28.433999999999997
922
+ - type: mrr_at_1
923
+ value: 25.494
924
+ - type: mrr_at_10
925
+ value: 33.735
926
+ - type: mrr_at_100
927
+ value: 34.791
928
+ - type: mrr_at_1000
929
+ value: 34.848
930
+ - type: mrr_at_3
931
+ value: 31.225
932
+ - type: mrr_at_5
933
+ value: 32.688
934
+ - type: ndcg_at_1
935
+ value: 25.494
936
+ - type: ndcg_at_10
937
+ value: 35.038000000000004
938
+ - type: ndcg_at_100
939
+ value: 41.499
940
+ - type: ndcg_at_1000
941
+ value: 44.183
942
+ - type: ndcg_at_3
943
+ value: 30.305
944
+ - type: ndcg_at_5
945
+ value: 32.607
946
+ - type: precision_at_1
947
+ value: 25.494
948
+ - type: precision_at_10
949
+ value: 6.739000000000001
950
+ - type: precision_at_100
951
+ value: 1.439
952
+ - type: precision_at_1000
953
+ value: 0.233
954
+ - type: precision_at_3
955
+ value: 14.163
956
+ - type: precision_at_5
957
+ value: 10.474
958
+ - type: recall_at_1
959
+ value: 21.409
960
+ - type: recall_at_10
961
+ value: 46.033
962
+ - type: recall_at_100
963
+ value: 74.932
964
+ - type: recall_at_1000
965
+ value: 92.35600000000001
966
+ - type: recall_at_3
967
+ value: 32.858
968
+ - type: recall_at_5
969
+ value: 38.675
970
+ - task:
971
+ type: Retrieval
972
+ dataset:
973
+ type: BeIR/cqadupstack
974
+ name: MTEB CQADupstackWordpressRetrieval
975
+ config: default
976
+ split: test
977
+ revision: None
978
+ metrics:
979
+ - type: map_at_1
980
+ value: 18.145
981
+ - type: map_at_10
982
+ value: 24.712
983
+ - type: map_at_100
984
+ value: 25.813000000000002
985
+ - type: map_at_1000
986
+ value: 25.935000000000002
987
+ - type: map_at_3
988
+ value: 22.33
989
+ - type: map_at_5
990
+ value: 23.524
991
+ - type: mrr_at_1
992
+ value: 19.224
993
+ - type: mrr_at_10
994
+ value: 26.194
995
+ - type: mrr_at_100
996
+ value: 27.208
997
+ - type: mrr_at_1000
998
+ value: 27.3
999
+ - type: mrr_at_3
1000
+ value: 23.906
1001
+ - type: mrr_at_5
1002
+ value: 24.988
1003
+ - type: ndcg_at_1
1004
+ value: 19.224
1005
+ - type: ndcg_at_10
1006
+ value: 29.015
1007
+ - type: ndcg_at_100
1008
+ value: 34.224
1009
+ - type: ndcg_at_1000
1010
+ value: 37.235
1011
+ - type: ndcg_at_3
1012
+ value: 24.22
1013
+ - type: ndcg_at_5
1014
+ value: 26.176
1015
+ - type: precision_at_1
1016
+ value: 19.224
1017
+ - type: precision_at_10
1018
+ value: 4.713
1019
+ - type: precision_at_100
1020
+ value: 0.787
1021
+ - type: precision_at_1000
1022
+ value: 0.11499999999999999
1023
+ - type: precision_at_3
1024
+ value: 10.290000000000001
1025
+ - type: precision_at_5
1026
+ value: 7.32
1027
+ - type: recall_at_1
1028
+ value: 18.145
1029
+ - type: recall_at_10
1030
+ value: 40.875
1031
+ - type: recall_at_100
1032
+ value: 64.371
1033
+ - type: recall_at_1000
1034
+ value: 86.67399999999999
1035
+ - type: recall_at_3
1036
+ value: 27.717000000000002
1037
+ - type: recall_at_5
1038
+ value: 32.381
1039
  - task:
1040
  type: Classification
1041
  dataset:
 
1116
  value: 77.95897780766644
1117
  - type: f1
1118
  value: 77.80380046125542
1119
+ - task:
1120
+ type: Clustering
1121
+ dataset:
1122
+ type: mteb/medrxiv-clustering-p2p
1123
+ name: MTEB MedrxivClusteringP2P
1124
+ config: default
1125
+ split: test
1126
+ revision: e7a26af6f3ae46b30dde8737f02c07b1505bcc73
1127
+ metrics:
1128
+ - type: v_measure
1129
+ value: 31.897956840478948
1130
+ - task:
1131
+ type: Clustering
1132
+ dataset:
1133
+ type: mteb/medrxiv-clustering-s2s
1134
+ name: MTEB MedrxivClusteringS2S
1135
+ config: default
1136
+ split: test
1137
+ revision: 35191c8c0dca72d8ff3efcd72aa802307d469663
1138
+ metrics:
1139
+ - type: v_measure
1140
+ value: 30.71493744677591
1141
+ - task:
1142
+ type: Reranking
1143
+ dataset:
1144
+ type: mteb/mind_small
1145
+ name: MTEB MindSmallReranking
1146
+ config: default
1147
+ split: test
1148
+ revision: 3bdac13927fdc888b903db93b2ffdbd90b295a69
1149
+ metrics:
1150
+ - type: map
1151
+ value: 31.279419910393734
1152
+ - type: mrr
1153
+ value: 32.41989483774563
1154
+ - task:
1155
+ type: Clustering
1156
+ dataset:
1157
+ type: mteb/reddit-clustering
1158
+ name: MTEB RedditClustering
1159
+ config: default
1160
+ split: test
1161
+ revision: 24640382cdbf8abc73003fb0fa6d111a705499eb
1162
+ metrics:
1163
+ - type: v_measure
1164
+ value: 50.49612915002382
1165
+ - task:
1166
+ type: Clustering
1167
+ dataset:
1168
+ type: mteb/reddit-clustering-p2p
1169
+ name: MTEB RedditClusteringP2P
1170
+ config: default
1171
+ split: test
1172
+ revision: 282350215ef01743dc01b456c7f5241fa8937f16
1173
+ metrics:
1174
+ - type: v_measure
1175
+ value: 60.29912718965653
1176
  - task:
1177
  type: STS
1178
  dataset:
 
1362
  value: 86.2546330637872
1363
  - type: manhattan_spearman
1364
  value: 86.46309860938591
1365
+ - task:
1366
+ type: Reranking
1367
+ dataset:
1368
+ type: mteb/scidocs-reranking
1369
+ name: MTEB SciDocsRR
1370
+ config: default
1371
+ split: test
1372
+ revision: d3c5e1fc0b855ab6097bf1cda04dd73947d7caab
1373
+ metrics:
1374
+ - type: map
1375
+ value: 85.009977767778
1376
+ - type: mrr
1377
+ value: 95.59795143128476
1378
  - task:
1379
  type: PairClassification
1380
  dataset:
 
1413
  - type: euclidean_precision
1414
  value: 94.04388714733543
1415
  - type: euclidean_recall
1416
+ value: 90.0
1417
  - type: manhattan_accuracy
1418
  value: 99.84158415841584
1419
  - type: manhattan_ap
 
1430
  value: 96.25445889914926
1431
  - type: max_f1
1432
  value: 92.03805708562844
1433
+ - task:
1434
+ type: Clustering
1435
+ dataset:
1436
+ type: mteb/stackexchange-clustering
1437
+ name: MTEB StackExchangeClustering
1438
+ config: default
1439
+ split: test
1440
+ revision: 6cbc1f7b2bc0622f2e39d2c77fa502909748c259
1441
+ metrics:
1442
+ - type: v_measure
1443
+ value: 59.26454683321409
1444
+ - task:
1445
+ type: Clustering
1446
+ dataset:
1447
+ type: mteb/stackexchange-clustering-p2p
1448
+ name: MTEB StackExchangeClusteringP2P
1449
+ config: default
1450
+ split: test
1451
+ revision: 815ca46b2622cec33ccafc3735d572c266efdb44
1452
+ metrics:
1453
+ - type: v_measure
1454
+ value: 33.75520575713765
1455
+ - task:
1456
+ type: Reranking
1457
+ dataset:
1458
+ type: mteb/stackoverflowdupquestions-reranking
1459
+ name: MTEB StackOverflowDupQuestions
1460
+ config: default
1461
+ split: test
1462
+ revision: e185fbe320c72810689fc5848eb6114e1ef5ec69
1463
+ metrics:
1464
+ - type: map
1465
+ value: 52.74607778008495
1466
+ - type: mrr
1467
+ value: 53.55101699770818
1468
  - task:
1469
  type: Classification
1470
  dataset:
 
1493
  value: 60.01980758347483
1494
  - type: f1
1495
  value: 60.35679678249753
1496
+ - task:
1497
+ type: Clustering
1498
+ dataset:
1499
+ type: mteb/twentynewsgroups-clustering
1500
+ name: MTEB TwentyNewsgroupsClustering
1501
+ config: default
1502
+ split: test
1503
+ revision: 6125ec4e24fa026cec8a478383ee943acfbd5449
1504
+ metrics:
1505
+ - type: v_measure
1506
+ value: 45.09419243325077
1507
  - task:
1508
  type: PairClassification
1509
  dataset: