region:us
---
dataset_info:
  features:
  - name: symbol
    dtype: string
  - name: body
    dtype: string
  - name: publisher
    dtype: string
  - name: publish_time
    dtype: timestamp[ns, tz=GMT]
  - name: title
    dtype: string
  - name: url
    dtype: string
  - name: uuid
    dtype: string
  splits:
  - name: train
    num_bytes: 106338656
    num_examples: 22037
  download_size: 52073398
  dataset_size: 106338656
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---
# Dataset Card for "news-sp500"

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** https://edarchimbaud.substack.com
- **Repository:** https://github.com/edarchimbaud
- **Point of Contact:** contact@edarchimbaud.com

### Dataset Summary

The news-sp500 dataset provides news articles related to companies in the S&P 500 index.

### Supported Tasks and Leaderboards

The dataset can be used for various natural language processing tasks such as text classification, sentiment analysis, information extraction, etc. It does not have a specific leaderboard associated with it.

### Languages

The dataset contains news articles in multiple languages.

## Dataset Structure

### Data Instances

The dataset consists of [1563] data instances.

### Data Fields

- symbol (string): A string representing the ticker symbol or abbreviation used to identify the company.
- body (string): The main content of the news article.
- publisher (string): The name of the publisher or news agency.
- publish_time (timestamp[ns, tz=GMT]): A timestamp indicating the publication time of the news article in GMT timezone.
- title (string): The title or headline of the news article.
- url (string): The URL or link to the original news article.
- uuid (string): A unique identifier for the news article.

### Data Splits

The dataset consists of a single split called train.

## Dataset Creation

### Curation Rationale

The news-sp500 dataset was created to provide a collection of news articles related to companies in the S&P 500 index for research and analysis purposes.

### Source Data

#### Initial Data Collection and Normalization

The data was collected from various online news sources and normalized for consistency.

### Annotations

#### Annotation process

[N/A]

#### Who are the annotators?

[N/A]

### Personal and Sensitive Information

[N/A]

## Considerations for Using the Data

### Social Impact of Dataset

[N/A]

### Discussion of Biases

[N/A]

### Other Known Limitations

[N/A]

## Additional Information

### Dataset Curators

The news-sp500 dataset was collected by https://edarchimbaud.substack.com.

### Licensing Information

The news-sp500 dataset is licensed under the MIT License.

### Citation Information

> https://edarchimbaud.substack.com, news-sp500 dataset, GitHub repository, https://github.com/edarchimbaud

### Contributions

Thanks to [@edarchimbaud](https://github.com/edarchimbaud) for adding this dataset.