Haritz Puerto
commited on
Commit
•
e9eb90b
1
Parent(s):
24cd783
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
tags:
|
5 |
+
- QA
|
6 |
+
- Question Answering
|
7 |
+
- SQuAD
|
8 |
+
license: "mit"
|
9 |
+
datasets:
|
10 |
+
- squad
|
11 |
+
metrics:
|
12 |
+
- squad
|
13 |
+
|
14 |
+
model-index:
|
15 |
+
- name: distilroberta-base
|
16 |
+
results:
|
17 |
+
- task:
|
18 |
+
type: question-answering # Required. Example: automatic-speech-recognition
|
19 |
+
name: Question Answering # Optional. Example: Speech Recognition
|
20 |
+
dataset:
|
21 |
+
type: squad # Required. Example: common_voice. Use dataset id from https://hf.co/datasets
|
22 |
+
name: SQuAD # Required. A pretty name for the dataset. Example: Common Voice (French)
|
23 |
+
split: validation # Optional. Example: test
|
24 |
+
|
25 |
+
metrics:
|
26 |
+
- type: squad # Required. Example: wer. Use metric id from https://hf.co/metrics
|
27 |
+
value: 76.37653736991486 # Required. Example: 20.90
|
28 |
+
name: SQuAD EM # Optional. Example: Test WER
|
29 |
+
config: exact_match # Optional. The name of the metric configuration used in `load_metric()`. Example: bleurt-large-512 in `load_metric("bleurt", "bleurt-large-512")`. See the `datasets` docs for more info: https://huggingface.co/docs/datasets/v2.1.0/en/loading#load-configurations
|
30 |
+
- type: squad # Required. Example: wer. Use metric id from https://hf.co/metrics
|
31 |
+
value: 84.5528918750732 # Required. Example: 20.90
|
32 |
+
name: SQuAD F1 # Optional. Example: Test WER
|
33 |
+
config: F1
|
34 |
+
|
35 |
+
---
|
36 |
+
|
37 |
+
distilroberta-base fined-tuned on SQuAD (https://huggingface.co/datasets/squad)
|
38 |
+
|
39 |
+
Hyperparameters:
|
40 |
+
- epochs: 1
|
41 |
+
- lr: 1e-5
|
42 |
+
- train batch sie: 16
|
43 |
+
- optimizer: adamW
|
44 |
+
- lr_scheduler: linear
|
45 |
+
- num warming steps: 0
|
46 |
+
- max_length: 512
|
47 |
+
|
48 |
+
Results on the dev set:
|
49 |
+
- 'exact_match': 76.37653736991486
|
50 |
+
- 'f1': 84.5528918750732
|