Hugging Face's logo

philipphager
/
baidu-ultr_uva-bert_naive-listwise

Transformers
Safetensors
bert
Inference Endpoints
Model card Files Community
philipphager commited on
Commit
c2c3caf
•
1 Parent(s): 6f41d41

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -17,14 +17,14 @@ A flax-based MonoBERT cross encoder trained on the [Baidu-ULTR](https://arxiv.or
17
 
18
  ## Test Results on Baidu-ULTR Expert Annotations
19
 
20
- | Model | log-likelihood | DCG@1 | DCG@3 | DCG@5 | DCG@10 | nDCG@10 | MRR@10 |
21
- |----------------------|----------------|--------|--------|--------|--------|---------|--------|
22
- | Pointwise Naive | 0.2272 | 1.6836 | 3.5616 | 4.8822 | 7.4244 | 0.3640 | 0.6096 |
23
- | Pointwise IPS | 0.2436 | 0.8842 | 2.0510 | 2.9535 | 4.8816 | 0.2363 | 0.4472 |
24
- | Pointwise Two Tower | 0.2178 | 1.4826 | 3.2636 | 4.5491 | 7.0979 | 0.3476 | 0.5856 |
25
  | **Listwise Naive** | - | **1.9738** | **4.1609** | **5.6861** | **8.5432** | **0.4091** | **0.6436** |
26
- | Listwise IPS | - | 1.7466 | 3.6378 | 4.9797 | 7.5790 | 0.3665 | 0.6112 |
27
- | Listwise DLA | - | 1.7954 | 3.8054 | 5.2083 | 7.9342 | 0.3848 | 0.6261 |
28
 
29
 
30
  ## Usage
 
17
 
18
  ## Test Results on Baidu-ULTR Expert Annotations
19
 
20
+ | Model | log-likelihood | DCG@1 | DCG@3 | DCG@5 | DCG@10 | nDCG@10 | MRR@10 |
21
+ |----------------------|----------------|----------|----------|----------|----------|----------|---------|
22
+ | Pointwise Naive | 0.2268 | 1.6411 | 3.4624 | 4.7520 | 7.2506 | 0.3567 | 0.6089 |
23
+ | Pointwise IPS | 0.2216 | 1.2948 | 2.8106 | 3.9767 | 6.2961 | 0.3075 | 0.5343 |
24
+ | Pointwise Two Tower | 0.2176 | 1.6288 | 3.4712 | 4.8220 | 7.4556 | 0.3668 | 0.6071 |
25
  | **Listwise Naive** | - | **1.9738** | **4.1609** | **5.6861** | **8.5432** | **0.4091** | **0.6436** |
26
+ | Listwise IPS | - | 1.7466 | 3.6378 | 4.9797 | 7.5790 | 0.3665 | 0.6112 |
27
+ | Listwise DLA | - | 1.7954 | 3.8054 | 5.2083 | 7.9342 | 0.3848 | 0.6261 |
28
 
29
 
30
  ## Usage