Commit
•
343f860
1
Parent(s):
7c6b3b6
Update README.md
Browse files
README.md
CHANGED
@@ -64,7 +64,7 @@ The model was evaluated using the binary test sets for MultiNLI, ANLI, LingNLI a
|
|
64 |
dataset | mnli-m-2c | mnli-mm-2c | fever-nli-2c | anli-all-2c | anli-r3-2c | lingnli-2c
|
65 |
--------|---------|----------|---------|----------|----------|------
|
66 |
accuracy | 0.925 | 0.922 | 0.892 | 0.676 | 0.665 | 0.888
|
67 |
-
speed (text/sec,
|
68 |
|
69 |
## Limitations and bias
|
70 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|
|
|
64 |
dataset | mnli-m-2c | mnli-mm-2c | fever-nli-2c | anli-all-2c | anli-r3-2c | lingnli-2c
|
65 |
--------|---------|----------|---------|----------|----------|------
|
66 |
accuracy | 0.925 | 0.922 | 0.892 | 0.676 | 0.665 | 0.888
|
67 |
+
speed (text/sec, CPU, 128 batch) | 6.0 | 6.3 | 3.0 | 5.8 | 5.0 | 7.6
|
68 |
|
69 |
## Limitations and bias
|
70 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|