philipphager
/

baidu-ultr_uva-bert_naive-listwise

Inference Endpoints

Model card Files Files and versions Community

philipphager commited on Apr 24

Commit

9679a8a

•

1 Parent(s): 0eecccb

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -19,7 +19,8 @@ A flax-based MonoBERT cross encoder trained on the [Baidu-ULTR](https://arxiv.or
 | Model           | log-likelihood | DCG@1  | DCG@3  | DCG@5  | DCG@10 | nDCG@10 | MRR@10 |
 |-----------------|----------------|--------|--------|--------|--------|---------|--------|
-| Naive Pointwise | 0.2272         | 1.6836 | 3.5616 | 4.8822 | 7.4244 | 0.3640  | 0.6096 |
 | **Naive Listwise**  | **0.7535**         | **1.9738** | **4.1609** | **5.6861** | **8.5432** | **0.4091**  | **0.6436** |
 ## Usage

 | Model           | log-likelihood | DCG@1  | DCG@3  | DCG@5  | DCG@10 | nDCG@10 | MRR@10 |
 |-----------------|----------------|--------|--------|--------|--------|---------|--------|
+| Pointwise Naive | 0.2272         | 1.6836 | 3.5616 | 4.8822 | 7.4244 | 0.3640  | 0.6096 |
+| Pointwise IPS   | 0.2436         | 0.8842 | 2.0510 | 2.9535 | 4.8816 | 0.2363  | 0.4472 |
 | **Naive Listwise**  | **0.7535**         | **1.9738** | **4.1609** | **5.6861** | **8.5432** | **0.4091**  | **0.6436** |
 ## Usage