lewtun HF staff commited on
Commit
aaf6515
1 Parent(s): 89db1c3

Add evaluation results on the plain_text config of squad

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config of the [squad](https://huggingface.co/datasets/squad) dataset by

@nbroad

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-project-squad-4b228794-1283349088).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=squad).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=squad).

Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -55,6 +55,23 @@ model-index:
55
  type: f1
56
  value: 79.3321
57
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
58
  ---
59
 
60
  xtremedistil-l12-h384 trained on SQuAD 2.0
 
55
  type: f1
56
  value: 79.3321
57
  verified: true
58
+ - task:
59
+ type: question-answering
60
+ name: Question Answering
61
+ dataset:
62
+ name: squad
63
+ type: squad
64
+ config: plain_text
65
+ split: validation
66
+ metrics:
67
+ - name: Exact Match
68
+ type: exact_match
69
+ value: 81.8604
70
+ verified: true
71
+ - name: F1
72
+ type: f1
73
+ value: 89.6654
74
+ verified: true
75
  ---
76
 
77
  xtremedistil-l12-h384 trained on SQuAD 2.0