entailment neutral
---
tags: autotrain
language: en
widget:
- text: "I love AutoTrain \U0001F917"
datasets:
- gabrielaltay/autotrain-data-at-test-bb-tmp-scitail
- bigscience-biomedical/tmp-scitail
co2_eq_emissions: 0.030427681636382462
model-index:
- name: gabrielaltay/autotrain-at-test-bb-tmp-scitail-1078438446
  results:
  - task:
      type: text-classification
      name: Text Classification
    dataset:
      name: bigscience-biomedical/tmp-scitail
      type: bigscience-biomedical/tmp-scitail
      config: scitail_bigbio_te
      split: test
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.7714016933207902
      verified: true
    - name: Precision
      type: precision
      value: 0.7829787234042553
      verified: true
    - name: Recall
      type: recall
      value: 0.8598130841121495
      verified: true
    - name: AUC
      type: auc
      value: 0.8606862462169141
      verified: true
    - name: F1
      type: f1
      value: 0.8195991091314032
      verified: true
    - name: loss
      type: loss
      value: 0.46928563714027405
      verified: true
---

# Model Trained Using AutoTrain

- Problem type: Binary Classification
- Model ID: 1078438446
- CO2 Emissions (in grams): 0.030427681636382462

## Validation Metrics

- Loss: 0.440134197473526
- Accuracy: 0.808282208588957
- Precision: 0.7823613086770982
- Recall: 0.8500772797527048
- AUC: 0.8850060812225493
- F1: 0.8148148148148148

## Usage

You can use cURL to access this model:

```
$ curl -X POST -H "Authorization: Bearer YOUR_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "I love AutoTrain"}' https://api-inference.huggingface.co/models/gabrielaltay/autotrain-at-test-bb-tmp-scitail-1078438446
```

Or Python API:

```
from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained("gabrielaltay/autotrain-at-test-bb-tmp-scitail-1078438446", use_auth_token=True)

tokenizer = AutoTokenizer.from_pretrained("gabrielaltay/autotrain-at-test-bb-tmp-scitail-1078438446", use_auth_token=True)

inputs = tokenizer("I love AutoTrain", return_tensors="pt")

outputs = model(**inputs)
```