Second, our Pyserini BM25 implementation outperforms the BM25 results reported in the original paper across all datasets.
Furthermore, the gap is larger for \(k=20\) .
On average, our results represent a nearly seven-point improvement in top-20 accuracy and a nearly five-point improvement for top-100 accuracy.
Since [1]} have not made available their code for generating the BM25 results, we are unable to further diagnose these differences.
