task_categories:tabular-regression language:en license:mit region:us
---
language:
- en
license: mit
task_categories:
- tabular-regression
dataset_info:
  features:
  - name: symbol
    dtype: string
  - name: date
    dtype: string
  - name: id
    dtype: int64
  - name: settlement_date
    dtype: timestamp[ns]
  - name: interest
    dtype: float64
  - name: avg_daily_share_volume
    dtype: float64
  - name: days_to_cover
    dtype: float64
  splits:
  - name: train
    num_bytes: 8887027
    num_examples: 143370
  download_size: 1018696
  dataset_size: 8887027
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---
# Dataset Card for "short-interest-sp500"

## Table of Contents
- [Table of Contents](#table-of-contents)
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** https://edarchimbaud.substack.com
- **Repository:** https://github.com/edarchimbaud
- **Point of Contact:** contact@edarchimbaud.com

### Dataset Summary

The short-interest-sp500 dataset provides short interest data for companies listed on the S&P 500 index. This includes the number of shares that have been sold short but have not yet been covered or closed out.

### Supported Tasks and Leaderboards

[N/A]

### Languages

[N/A]

## Dataset Structure

### Data Instances

[N/A]

### Data Fields

- symbol (string): A string representing the ticker symbol or abbreviation used to identify the company.
- date (string): A string representing the date when the data was collected.
- id (int64): A unique integer identifier for each data instance.
- settlement_date (timestamp[ns]): The date by which a buyer must pay for the securities delivered by the seller.
- interest (float64): A floating point number representing the short interest of the company on the specified date.
- avg_daily_share_volume (float64): A floating point number representing the average daily trading volume of the company.
- days_to_cover (float64): A floating point number representing the days to cover metric, which is the number of days volume worth of short interest.

### Data Splits

[N/A]

## Dataset Creation

### Curation Rationale

The short-interest-sp500 dataset was created to facilitate the study of market dynamics, particularly the role of short selling.

### Source Data

#### Initial Data Collection and Normalization

The dataset was compiled from publicly available sources.

### Annotations

#### Annotation process

[N/A]

#### Who are the annotators?

[N/A]

### Personal and Sensitive Information

[N/A]

## Considerations for Using the Data

### Social Impact of Dataset

[N/A]

### Discussion of Biases

[N/A]

### Other Known Limitations

[N/A]

## Additional Information

### Dataset Curators

The short-interest-sp500 dataset was collected by https://edarchimbaud.substack.com.

### Licensing Information

The short-interest-sp500 dataset is licensed under the MIT License.

### Citation Information

> https://edarchimbaud.substack.com, short-interest-sp500 dataset, GitHub repository, https://github.com/edarchimbaud

### Contributions

Thanks to [@edarchimbaud](https://github.com/edarchimbaud) for adding this dataset.