lewtun HF staff commited on
Commit
7f39e06
1 Parent(s): 5540fdf

Add evaluation results on the plain_text config of squad

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config of the [squad](https://huggingface.co/datasets/squad) dataset by

@mbartolo

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-squad-95d5e1fd-11835580).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=squad).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=squad).

Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -26,6 +26,23 @@ model-index:
26
  type: f1
27
  value: 87.41
28
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  ---
30
 
31
  # deberta-v3-base for QA
 
26
  type: f1
27
  value: 87.41
28
  verified: true
29
+ - task:
30
+ type: question-answering
31
+ name: Question Answering
32
+ dataset:
33
+ name: squad
34
+ type: squad
35
+ config: plain_text
36
+ split: validation
37
+ metrics:
38
+ - name: Exact Match
39
+ type: exact_match
40
+ value: 84.9678
41
+ verified: true
42
+ - name: F1
43
+ type: f1
44
+ value: 92.2777
45
+ verified: true
46
  ---
47
 
48
  # deberta-v3-base for QA