task_categories:sentence-similarity task_categories:feature-extraction language:en license:cc-by-4.0 region:us
---
license: cc-by-4.0
task_categories:
- sentence-similarity
- feature-extraction
language:
- en
---

# Dataset Card for "scidocs"

## Table of Contents
- [Table of Contents](#table-of-contents)
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
- [Additional Information](#additional-information)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)

## Dataset Description


- **Homepage:** [https://github.com/allenai/scidocs](https://github.com/allenai/scidocs)

### Dataset Summary

This is a modified version of the original scidocs dataset for retrieval tasks. The original is availabe [here](https://github.com/allenai/scidocs).

## Dataset Structure

### Data Instances

An example of 'train' looks as follows.

```json
{
    "title": "Discovery of inference rules for question-answering",
    "abstract": "One of the main challenges in question-answering is the potential mismatch between the expressions in questions and ...",
}
```

### Data Fields

The data fields are the same among all splits.

- `title`: a `string` feature.
- `abstract`: a `string` feature.

## Additional Information

### Licensing Information

This dataset is distributed under the cc-by-4.0 license.

### Citation Information

BibTeX:
```json
@inproceedings{specter2020cohan,
  title={SPECTER: Document-level Representation Learning using Citation-informed Transformers},
  author={Arman Cohan and Sergey Feldman and Iz Beltagy and Doug Downey and Daniel S. Weld},
  booktitle={ACL},
  year={2020}
}
```