task_categories:summarization task_categories:text2text-generation language:en arxiv ML region:us
---
dataset_info:
  features:
  - name: title
    dtype: string
  - name: abstract
    dtype: string
  splits:
  - name: train
    num_bytes: 130808836.19633989
    num_examples: 105832
  - name: test
    num_bytes: 14535413.803660113
    num_examples: 11760
  download_size: 81252051
  dataset_size: 145344250
language:
- en
pretty_name: ML ArXiv Papers
task_categories:
- summarization
- text2text-generation
tags:
- arxiv
- ML
---
# Dataset Card for "ml-arxiv-papers"

This is a dataset containing ML ArXiv papers. The dataset is a version of the original one from [CShorten](https://huggingface.co/datasets/CShorten/ML-ArXiv-Papers), which is a part of the ArXiv papers dataset from [Kaggle](https://www.kaggle.com/datasets/Cornell-University/arxiv). 
Three steps are made to process the source data:
1. useless columns removal;
2. train-test split;
3. '\n' removal and trimming spaces on sides of the text.

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)