task_categories:text-generation language:en license:mit region:us
This is a dataset consisting of the output from various language models and datasets.
@misc{storhaug2022output,
    title = {Output Dataset},
    author={André Storhaug},
    year={2023}
}
---
license: mit
task_categories:
- text-generation
language:
- en
dataset_info:
- config_name: gpt2-xl
  features:
  - name: id
    dtype: string
  - name: part
    sequence: int32
  - name: prompt
    dtype: string
  - name: reference
    dtype: string
  - name: prediction
    dtype: string
  - name: ended
    dtype: bool
  - name: meta
    struct:
    - name: subset
      dtype: string
  splits:
  - name: andstor.the_pile_github.greedy
    num_bytes: 60221138
    num_examples: 22169
  download_size: 66419674
  dataset_size: 60221138
- config_name: EleutherAI.gpt-j-6B
  features:
  - name: id
    dtype: string
  - name: part
    sequence: int32
  - name: prompt
    dtype: string
  - name: reference
    dtype: string
  - name: prediction
    dtype: string
  - name: ended
    dtype: bool
  - name: meta
    struct:
    - name: subset
      dtype: string
  splits:
  - name: andstor.the_pile_github.greedy
    num_bytes: 67625587
    num_examples: 20665
  download_size: 73049509
  dataset_size: 67625587
- config_name: NinedayWang.PolyCoder-2.7B
  features:
  - name: id
    dtype: string
  - name: part
    sequence: int32
  - name: prompt
    dtype: string
  - name: reference
    dtype: string
  - name: prediction
    dtype: string
  - name: ended
    dtype: bool
  - name: meta
    struct:
    - name: subset
      dtype: string
  splits:
  - name: andstor.the_pile_github.greedy
    num_bytes: 58822858
    num_examples: 20342
  download_size: 63717236
  dataset_size: 58822858
- config_name: Salesforce.codegen-16B-multi
  features:
  - name: id
    dtype: string
  - name: part
    sequence: int32
  - name: prompt
    dtype: string
  - name: reference
    dtype: string
  - name: prediction
    dtype: string
  - name: ended
    dtype: bool
  - name: meta
    struct:
    - name: subset
      dtype: string
  splits:
  - name: THUDM.humaneval_x.greedy
    num_bytes: 2509745
    num_examples: 820
  download_size: 2694784
  dataset_size: 2509745
- config_name: openai.gpt-3.5-turbo-0613
  features:
  - name: id
    dtype: string
  - name: part
    sequence: int32
  - name: prompt
    dtype: string
  - name: reference
    dtype: string
  - name: prediction
    dtype: string
  - name: ended
    dtype: bool
  - name: meta
    struct:
    - name: subset
      dtype: string
  splits:
  - name: THUDM.humaneval_x.greedy
    num_bytes: 958178
    num_examples: 820
  download_size: 1067958
  dataset_size: 958178
- config_name: openai.gpt-4-0613
  features:
  - name: id
    dtype: string
  - name: part
    sequence: int32
  - name: prompt
    dtype: string
  - name: reference
    dtype: string
  - name: prediction
    dtype: string
  - name: ended
    dtype: bool
  - name: meta
    struct:
    - name: subset
      dtype: string
  splits:
  - name: THUDM.humaneval_x.greedy
    num_bytes: 875401
    num_examples: 820
  - name: THUDM.humaneval_x.random
    num_bytes: 906274
    num_examples: 820
  download_size: 1995455
  dataset_size: 1781675
---

# Dataset Card for Output

## Table of Contents
- [Table of Contents](#table-of-contents)
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
    - [Initial Data Collection and Normalization](#initial-data-collection-and-normalization)
    - [Who are the source language producers?](#who-are-the-source-language-producers)
  - [Annotations](#annotations)
    - [Annotation process](#annotation-process)
    - [Who are the annotators?](#who-are-the-annotators)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** https://github.com/andstor/lm-output-dataset
- **Repository:** https://github.com/andstor/lm-output-dataset
- **Paper:** 
- **Leaderboard:**
- **Point of Contact:** [André Storhaug](mailto:andr3.storhaug@gmail.com)

### Dataset Summary

This is a dataset of various language model outputs from different datasets.

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

[More Information Needed]

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

[More Information Needed]

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

[More Information Needed]

### Contributions

Thanks to [@andstor](https://github.com/andstor) for adding this dataset.
