Question Answering
Transformers
PyTorch
English
electra
Eval Results
Inference Endpoints
lewtun HF staff commited on
Commit
80e32e7
1 Parent(s): 65fac8b

Add evaluation results on the adversarialQA config of adversarial_qa

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the adversarialQA config of the [adversarial_qa](https://huggingface.co/datasets/adversarial_qa) dataset by

@mbartolo

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-adversarial_qa-58460439-11825574).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=adversarial_qa).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=adversarial_qa).

Files changed (1) hide show
  1. README.md +21 -1
README.md CHANGED
@@ -3,7 +3,7 @@ language:
3
  - en
4
  tags:
5
  - question-answering
6
- license: "apache-2.0"
7
  datasets:
8
  - adversarial_qa
9
  - mbartolo/synQA
@@ -11,6 +11,26 @@ datasets:
11
  metrics:
12
  - exact_match
13
  - f1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ---
15
 
16
  # Model Overview
 
3
  - en
4
  tags:
5
  - question-answering
6
+ license: apache-2.0
7
  datasets:
8
  - adversarial_qa
9
  - mbartolo/synQA
 
11
  metrics:
12
  - exact_match
13
  - f1
14
+ model-index:
15
+ - name: mbartolo/electra-large-synqa
16
+ results:
17
+ - task:
18
+ type: question-answering
19
+ name: Question Answering
20
+ dataset:
21
+ name: adversarial_qa
22
+ type: adversarial_qa
23
+ config: adversarialQA
24
+ split: validation
25
+ metrics:
26
+ - name: Exact Match
27
+ type: exact_match
28
+ value: 54.3667
29
+ verified: true
30
+ - name: F1
31
+ type: f1
32
+ value: 67.3589
33
+ verified: true
34
  ---
35
 
36
  # Model Overview