Commit
•
906c8c1
1
Parent(s):
03678c6
Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ widget:
|
|
12 |
---
|
13 |
# DeBERTa-v3-xsmall-mnli-fever-anli-ling-binary
|
14 |
## Model description
|
15 |
-
This model was trained on
|
16 |
|
17 |
Note that the model was trained on binary NLI to predict either "entailment" or "not-entailment". This is specifically designed for zero-shot classification, where the difference between "neutral" and "contradiction" is irrelevant.
|
18 |
|
@@ -39,7 +39,7 @@ prediction = {name: round(float(pred) * 100, 1) for pred, name in zip(prediction
|
|
39 |
print(prediction)
|
40 |
```
|
41 |
### Training data
|
42 |
-
This model was trained on
|
43 |
|
44 |
### Training procedure
|
45 |
DeBERTa-v3-xsmall-mnli-fever-anli-ling-binary was trained using the Hugging Face trainer with the following hyperparameters.
|
@@ -55,7 +55,7 @@ training_args = TrainingArguments(
|
|
55 |
)
|
56 |
```
|
57 |
### Eval results
|
58 |
-
The model was evaluated using the binary test sets for MultiNLI
|
59 |
|
60 |
mnli-m-2c | mnli-mm-2c | fever-nli-2c | anli-all-2c | anli-r3-2c | lingnli-2c
|
61 |
---------|----------|---------|----------|----------|------
|
|
|
12 |
---
|
13 |
# DeBERTa-v3-xsmall-mnli-fever-anli-ling-binary
|
14 |
## Model description
|
15 |
+
This model was trained on 782 357 hypothesis-premise pairs from 4 NLI datasets: [MultiNLI](https://huggingface.co/datasets/multi_nli), [Fever-NLI](https://github.com/easonnie/combine-FEVER-NSMN/blob/master/other_resources/nli_fever.md), [LingNLI](https://arxiv.org/abs/2104.07179) and [ANLI](https://github.com/facebookresearch/anli).
|
16 |
|
17 |
Note that the model was trained on binary NLI to predict either "entailment" or "not-entailment". This is specifically designed for zero-shot classification, where the difference between "neutral" and "contradiction" is irrelevant.
|
18 |
|
|
|
39 |
print(prediction)
|
40 |
```
|
41 |
### Training data
|
42 |
+
This model was trained on 782 357 hypothesis-premise pairs from 4 NLI datasets: [MultiNLI](https://huggingface.co/datasets/multi_nli), [Fever-NLI](https://github.com/easonnie/combine-FEVER-NSMN/blob/master/other_resources/nli_fever.md), [LingNLI](https://arxiv.org/abs/2104.07179) and [ANLI](https://github.com/facebookresearch/anli).
|
43 |
|
44 |
### Training procedure
|
45 |
DeBERTa-v3-xsmall-mnli-fever-anli-ling-binary was trained using the Hugging Face trainer with the following hyperparameters.
|
|
|
55 |
)
|
56 |
```
|
57 |
### Eval results
|
58 |
+
The model was evaluated using the binary test sets for MultiNLI, ANLI, LingNLI and the binary dev set for Fever-NLI (two classes instead of three). The metric used is accuracy.
|
59 |
|
60 |
mnli-m-2c | mnli-mm-2c | fever-nli-2c | anli-all-2c | anli-r3-2c | lingnli-2c
|
61 |
---------|----------|---------|----------|----------|------
|