Update README.md
Browse files
README.md
CHANGED
@@ -57,7 +57,7 @@ Our fine-tuned BERT model is this repository. Our Package also supports download
|
|
57 |
from qa_metrics.transformerMatcher import TransformerMatcher
|
58 |
|
59 |
question = "who will take the throne after the queen dies"
|
60 |
-
tm = TransformerMatcher("
|
61 |
scores = tm.get_scores(reference_answer, candidate_answer, question)
|
62 |
match_result = tm.transformer_match(reference_answer, candidate_answer, question)
|
63 |
print("Score: %s; CF Match: %s" % (scores, match_result))
|
@@ -89,6 +89,7 @@ print("Score: %s; CF Match: %s" % (scores, match_result))
|
|
89 |
- [01/24/24] 🔥 The full paper is uploaded and can be accessed [here]([https://arxiv.org/abs/2310.14566](https://arxiv.org/abs/2401.13170)). The dataset is expanded and leaderboard is updated.
|
90 |
- Our Training Dataset is adapted and augmented from [Bulian et al](https://github.com/google-research-datasets/answer-equivalence-dataset). Our [dataset repo](https://github.com/zli12321/Answer_Equivalence_Dataset.git) includes the augmented training set and QA evaluation testing sets discussed in our paper.
|
91 |
|
|
|
92 |
## License
|
93 |
|
94 |
This project is licensed under the [MIT License](LICENSE.md) - see the LICENSE file for details.
|
|
|
57 |
from qa_metrics.transformerMatcher import TransformerMatcher
|
58 |
|
59 |
question = "who will take the throne after the queen dies"
|
60 |
+
tm = TransformerMatcher("distilroberta")
|
61 |
scores = tm.get_scores(reference_answer, candidate_answer, question)
|
62 |
match_result = tm.transformer_match(reference_answer, candidate_answer, question)
|
63 |
print("Score: %s; CF Match: %s" % (scores, match_result))
|
|
|
89 |
- [01/24/24] 🔥 The full paper is uploaded and can be accessed [here]([https://arxiv.org/abs/2310.14566](https://arxiv.org/abs/2401.13170)). The dataset is expanded and leaderboard is updated.
|
90 |
- Our Training Dataset is adapted and augmented from [Bulian et al](https://github.com/google-research-datasets/answer-equivalence-dataset). Our [dataset repo](https://github.com/zli12321/Answer_Equivalence_Dataset.git) includes the augmented training set and QA evaluation testing sets discussed in our paper.
|
91 |
|
92 |
+
|
93 |
## License
|
94 |
|
95 |
This project is licensed under the [MIT License](LICENSE.md) - see the LICENSE file for details.
|