task_categories:question-answering task_categories:text2text-generation size_categories:10K<n<100K language:en region:us
---
task_categories:
- question-answering
- text2text-generation
language:
- en
size_categories:
- 10K<n<100K
---

# Arxiv Paper Generative Question Answering 

## Dataset Description

- **Homepage:** 
- **Repository:** 
- **Paper:** 
- **Leaderboard:** 
- **Point of Contact:** 

### Dataset Summary

This dataset is made using ChatGPT (text-davinci-003) to generate Question/Answer pairs from Arxiv papers from [this dataset](https://huggingface.co/datasets/ccdv/arxiv-summarization)


### Data Fields

* TextID: references the datarow (paper) in the arxiv summarizer dataset
* Question: question based on the text
* Response: answer
* Text: Full text with the paper as 'context:' and and the question appended as 'question:'. Used for generative question answering usign language modelling

### Data Splits

This dataset contains 2 splits: _train_, and _validation_

| Dataset Split | Number of Instances |
| ------------- | --------------------|
| Train         | 32,392              |
| Validation    | 6,479               |