language:en license:wtfpl region:us
A preprocessed version of the Standford Question Answering Dataset (SQuAD) version 2.0 consisting of contexts and questions only.

Duplicate contexts have been removed and corresponding questions have been merged into an array per context.

Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the answer to every question is a segment of text, or span, from the corresponding reading passage, or the question might be unanswerable. 
SQuAD 2.0 combines the 100,000 questions in SQuAD1.1 with over 50,000 unanswerable questions written adversarially by crowdworkers to look similar to answerable ones. To do well on SQuAD 2.0, systems must not only answer questions when possible, but also determine when no answer is supported by the paragraph and abstain from answering.
@article{2018arXiv160605250R,
       author = {{Rajpurkar}, Robin, Jian and {Liang}, Percy},
        title = "{Know What You Don't Know: Unanswerable Questions for SQuAD}",
      journal = {arXiv e-prints},
         year = 2018,
          eid = {arXiv:1806.03822v1},
        pages = {arXiv:1806.03822v1},
archivePrefix = {arXiv},
       eprint = {1806.03822v1},
}
---
license: wtfpl
dataset_info:
- config_name: v2
  features:
  - name: context
    dtype: string
  - name: questions
    dtype: string
  splits:
  - name: train
    num_bytes: 20328952
    num_examples: 18877
  - name: validation
    num_bytes: 1419411
    num_examples: 1204
  download_size: 24163282
  dataset_size: 21748363
- config_name: v1
  features:
  - name: context
    dtype: string
  - name: questions
    dtype: string
  splits:
  - name: train
    num_bytes: 20391081
    num_examples: 18891
  - name: validation
    num_bytes: 2389185
    num_examples: 2067
  download_size: 25308169
  dataset_size: 22780266
language:
- en
pretty_name: The SQuAD QG Dataset
---

# The SQuAD QG Dataset

## Description

[Stanford Question Answering Dataset (SQuAD)](https://rajpurkar.github.io/SQuAD-explorer/) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the answer to every question is a segment of text, or span, from the corresponding reading passage, or the question might be unanswerable.

This modified version is aimed at question generation; 
each entry only contains contexts and questions concatenated to a single string related to the specific context. 

`The SQuAD` unites SQuAD 1.1 and 2.0 in two subsets each containing a `train` and `validation` split.


## Dataset Structure

### Data Instances

An example entry looks as follows:

```python
{
  context: "This is a test context",
  questions: ["Is this a test?", "Is this a test context?"]
}
```

### Data Fields

The dataset has the following fields:

* context: a string feature
* questions: a string feature

**NB:** The data fields are the same among all splits.

### Data Splits

| name | train | validation |
|------|-------|------------|
| v1   | 18891 | 2067       |
| v2   | 18877 | 1204       |
