research-backup
/

relbert-roberta-large-iloob-e-semeval2012

Feature Extraction

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Community

asahi417 commited on Feb 10, 2023

Commit

2763caa

•

1 Parent(s): e2036b4

model update

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -102,7 +102,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.6010928961748634
   - task:
       name: Analogy Questions (NELL-ONE Analogy)
       type: multiple-choice-qa
@@ -198,7 +198,7 @@ This model achieves the following results on the relation understanding tasks:
     - Accuracy on U4: 0.5925925925925926
     - Accuracy on Google: 0.938
     - Accuracy on ConceptNet Analogy: 0.3775167785234899
-    - Accuracy on T-Rex Analogy: 0.6010928961748634
     - Accuracy on NELL-ONE Analogy: 0.6583333333333333
 - Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-iloob-e-semeval2012/raw/main/classification.json)):
     - Micro F1 score on BLESS: 0.9219526894681332

     metrics:
     - name: Accuracy
       type: accuracy
+      value: 0.5956284153005464
   - task:
       name: Analogy Questions (NELL-ONE Analogy)
       type: multiple-choice-qa
     - Accuracy on U4: 0.5925925925925926
     - Accuracy on Google: 0.938
     - Accuracy on ConceptNet Analogy: 0.3775167785234899
+    - Accuracy on T-Rex Analogy: 0.5956284153005464
     - Accuracy on NELL-ONE Analogy: 0.6583333333333333
 - Lexical Relation Classification ([dataset](https://huggingface.co/datasets/relbert/lexical_relation_classification), [full result](https://huggingface.co/relbert/relbert-roberta-large-iloob-e-semeval2012/raw/main/classification.json)):
     - Micro F1 score on BLESS: 0.9219526894681332