task_categories:text-generation size_categories:1K<n<10K language:en license:apache-2.0 code python code-generation region:us
---
dataset_info:
  features:
  - name: instruction
    dtype: string
  - name: input
    dtype: string
  - name: output
    dtype: string
  splits:
  - name: train
    num_bytes: 1930175
    num_examples: 4742
  download_size: 741759
  dataset_size: 1930175
license: apache-2.0
task_categories:
- text-generation
language:
- en
tags:
- code
- python
- code-generation
size_categories:
- 1K<n<10K
---
# Dataset Card for "oig_small_chip2_python"


### Dataset Summary

From [LAION's Open Instruction Generalist (OIG) dataset](https://huggingface.co/datasets/laion/OIG), we use a 4775-prompt segment pertaining to Python code generation. OIG text elements are formatted as dialogue exerpts between a "human" and "bot" agent. The code generation prompt is parsed from the initial "human" agent's statement and the resultant response from the "bot" agent's statement. We then reformat the text/response pairs according to the format of the original Alpaca dataset; that is, instruction/input/output triplets. In cases where the instruction field does not specify the code language, we provide "Write the code in Python" in the input field. Otherwise, the input field is left blank.

The OIG dataset was prepared by LAION, and released under the Apache 2.0 license.

Numbers:
- **Prompts**: 4775
- **Tokens**: 578083 using the [EleutherAI/gpt-neox-20b](https://huggingface.co/EleutherAI/gpt-neox-20b) tokenizer (counting instruction+input+output)