task_categories:text-classification size_categories:100K<n<1M language:en NLI region:us
---
dataset_info:
  features:
  - name: uid
    dtype: string
  - name: premise
    dtype: string
  - name: hypothesis
    dtype: string
  - name: label
    dtype:
      class_label:
        names:
          '0': entailment
          '1': neutral
          '2': contradiction
  - name: reason
    dtype: string
  splits:
  - name: train
    num_bytes: 44720719
    num_examples: 100459
  - name: validation
    num_bytes: 663148
    num_examples: 1200
  - name: test
    num_bytes: 657586
    num_examples: 1200
  download_size: 15202058
  dataset_size: 46041453
task_categories:
- text-classification
language:
- en
tags:
- NLI
size_categories:
- 100K<n<1M
---
# The Adversarial Natural Language Inference (ANLI)

- Source: https://huggingface.co/datasets/anli
- Num examples: 
  - 100,459 (train)
  - 1,200 (validation)
  - 1,200 (test)
- Language: English

```python
from datasets import load_dataset

load_dataset("vietgpt/anli_r3_en")
```

- Format for NLI task

```python
def preprocess(sample):
    premise = sample['premise']
    hypothesis = sample['hypothesis']
    label = sample['label']

    if label == 0:
        label = "entailment"
    elif label == 1:
        label = "neutral"
    else:
        label = "contradiction"
    return {'text': f'<|startoftext|><|premise|> {premise} <|hypothesis|> {hypothesis} <|label|> {label} <|endoftext|>'}

"""
<|startoftext|><|premise|> TOKYO, Dec 18 (Reuters) - Japan’s Shionogi & Co said on Tuesday that it has applied to health regulators in the United States, Canada and Europe for approval of its HIV drug Dolutegravir. Shionogi developed Dolutegravir with a Viiv Healthcare, an AIDS drug joint venture between GlaxoSmithKline and Pfizer, in exchange for its rights to the drug. <|hypothesis|> The article was written on December 18th. <|label|> entailment <|endoftext|>
"""
```

- Format for Rationale task

```python
def preprocess_rationale(sample):
    premise = sample['premise']
    hypothesis = sample['hypothesis']
    rationale = sample['reason']

    return {'text': f'<|startoftext|><|premise|> {premise} <|hypothesis|> {hypothesis} <|rationale|> {rationale} <|endoftext|>'}

"""
<|startoftext|><|premise|> TOKYO, Dec 18 (Reuters) - Japan’s Shionogi & Co said on Tuesday that it has applied to health regulators in the United States, Canada and Europe for approval of its HIV drug Dolutegravir. Shionogi developed Dolutegravir with a Viiv Healthcare, an AIDS drug joint venture between GlaxoSmithKline and Pfizer, in exchange for its rights to the drug. <|hypothesis|> The article was written on December 18th. <|rationale|> TOKYO, Dec 18 (Reuters) is when the article was written as it states in the first words of the sentence <|endoftext|>
"""
```

- Format for GPT-3

```python
def preprocess_gpt3(sample):
    premise = sample['premise']
    hypothesis = sample['hypothesis']
    label = sample['label']

    if label == 0:
        output = f'\n<|correct|> True\n<|incorrect|> False\n<|incorrect|> Neither'
    elif label == 1:
        output = f'\n<|correct|> Neither\n<|incorrect|> True\n<|incorrect|> False'
    else:
        output = f'\n<|correct|> False\n<|incorrect|> True\n<|incorrect|> Neither'

    return {'text': f'<|startoftext|> anli 2: {premise} <|question|> {hypothesis}\nTrue, False, or Neither? <|answer|> {output} <|endoftext|>'}

"""
<|startoftext|> anli 2: TOKYO, Dec 18 (Reuters) - Japan’s Shionogi & Co said on Tuesday that it has applied to health regulators in the United States, Canada and Europe for approval of its HIV drug Dolutegravir. Shionogi developed Dolutegravir with a Viiv Healthcare, an AIDS drug joint venture between GlaxoSmithKline and Pfizer, in exchange for its rights to the drug. <|question|> The article was written on December 18th.
True, False, or Neither? <|answer|> 
<|correct|> True
<|incorrect|> False
<|incorrect|> Neither <|endoftext|>
"""
```