autoevaluator HF staff commited on
Commit
7666039
1 Parent(s): a197dde

Add evaluation results on the squad_v2 config and validation split of squad_v2

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the squad_v2 config and validation split of the [squad_v2](https://huggingface.co/datasets/squad_v2) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-squad_v2-squad_v2-8571ec-1652758614).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=squad_v2).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=squad_v2).

Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -6,7 +6,24 @@ datasets:
6
  - squad
7
  model-index:
8
  - name: microsoft_deberta-base_squad
9
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
6
  - squad
7
  model-index:
8
  - name: microsoft_deberta-base_squad
9
+ results:
10
+ - task:
11
+ type: question-answering
12
+ name: Question Answering
13
+ dataset:
14
+ name: squad_v2
15
+ type: squad_v2
16
+ config: squad_v2
17
+ split: validation
18
+ metrics:
19
+ - name: Exact Match
20
+ type: exact_match
21
+ value: 42.5948
22
+ verified: true
23
+ - name: F1
24
+ type: f1
25
+ value: 46.1837
26
+ verified: true
27
  ---
28
 
29
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You