Spaces:
Runtime error
Runtime error
Add table
Browse files
README.md
CHANGED
@@ -10,4 +10,18 @@ app_file: app.py
|
|
10 |
|
11 |
# AutoEvaluate
|
12 |
|
13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
|
11 |
# AutoEvaluate
|
12 |
|
13 |
+
> Submit evaluation jobs to AutoTrain from the Hugging Face Hub
|
14 |
+
|
15 |
+
## Supported tasks
|
16 |
+
|
17 |
+
The table below shows which tasks are currently supported for evaluation in the AutoTrain backend:
|
18 |
+
|
19 |
+
| Task | Supported | Sample prediction repository |
|
20 |
+
|:--------------------------------|:---------:|:------------------------------------------------------------------------------------|
|
21 |
+
| `binary_classification` | β
| [`eval-staging-835`](https://huggingface.co/datasets/autoevaluate/eval-staging-835) |
|
22 |
+
| `multi_class_classification` | β
| [`eval-staging-822`](https://huggingface.co/datasets/autoevaluate/eval-staging-822) |
|
23 |
+
| `multi_label_classification` | β | |
|
24 |
+
| `entity_extraction` | β
| [`eval-staging-838`](https://huggingface.co/datasets/autoevaluate/eval-staging-838) |
|
25 |
+
| `extractive_question_answering` | β | |
|
26 |
+
| `translation` | β | |
|
27 |
+
| `summarization` | β | |
|
app.py
CHANGED
@@ -26,7 +26,7 @@ TASK_TO_ID = {
|
|
26 |
}
|
27 |
|
28 |
# TODO: remove this hardcorded logic and accept any dataset on the Hub
|
29 |
-
DATASETS_TO_EVALUATE = ["emotion", "conll2003", "imdb", "squad", "xsum", "ncbi_disease"]
|
30 |
|
31 |
###########
|
32 |
### APP ###
|
|
|
26 |
}
|
27 |
|
28 |
# TODO: remove this hardcorded logic and accept any dataset on the Hub
|
29 |
+
DATASETS_TO_EVALUATE = ["emotion", "conll2003", "imdb", "squad", "xsum", "ncbi_disease", "go_emotions"]
|
30 |
|
31 |
###########
|
32 |
### APP ###
|