model update
Browse files
README.md
CHANGED
@@ -102,7 +102,7 @@ model-index:
|
|
102 |
metrics:
|
103 |
- name: Accuracy
|
104 |
type: accuracy
|
105 |
-
value: 0.
|
106 |
- task:
|
107 |
name: Analogy Questions (NELL-ONE Analogy)
|
108 |
type: multiple-choice-qa
|
@@ -198,7 +198,7 @@ This model achieves the following results on the relation understanding tasks:
|
|
198 |
- Accuracy on U4: 0.5856481481481481
|
199 |
- Accuracy on Google: 0.914
|
200 |
- Accuracy on ConceptNet Analogy: 0.46057046979865773
|
201 |
-
- Accuracy on T-Rex Analogy: 0.
|
202 |
- Accuracy on NELL-ONE Analogy: 0.6183333333333333
|
203 |
- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-iloob-a-semeval2012/raw/main/classification.json)):
|
204 |
- Micro F1 score on BLESS: 0.9180352568931747
|
|
|
102 |
metrics:
|
103 |
- name: Accuracy
|
104 |
type: accuracy
|
105 |
+
value: 0.639344262295082
|
106 |
- task:
|
107 |
name: Analogy Questions (NELL-ONE Analogy)
|
108 |
type: multiple-choice-qa
|
|
|
198 |
- Accuracy on U4: 0.5856481481481481
|
199 |
- Accuracy on Google: 0.914
|
200 |
- Accuracy on ConceptNet Analogy: 0.46057046979865773
|
201 |
+
- Accuracy on T-Rex Analogy: 0.639344262295082
|
202 |
- Accuracy on NELL-ONE Analogy: 0.6183333333333333
|
203 |
- Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-iloob-a-semeval2012/raw/main/classification.json)):
|
204 |
- Micro F1 score on BLESS: 0.9180352568931747
|