region:us
---
dataset_info:
  features:
  - name: instruction
    dtype: string
  - name: output
    dtype: string
  - name: input
    dtype: string
  splits:
  - name: train
    num_bytes: 54969398.0
    num_examples: 150453
  download_size: 34598598
  dataset_size: 54969398.0
---
# Dataset Card for "oig_small_chip2_noncode"

From LAION's Open Instruction Generalist (OIG) dataset, we provide a subset whose samples are not code-related. OIG text elements are formatted as dialogue exerpts between a "human" and "bot" agent. The code generation prompt is parsed from the initial "human" agent's statement and the resultant response from the "bot" agent's statement. We then reformat the text/response pairs according to the format of the original Alpaca dataset; that is, instruction/input/output triplets.

The OIG dataset was prepared by LAION, and released under the Apache 2.0 license.

Numbers:

Prompts: 150453

Tokens: 11522004 using the EleutherAI/gpt-neox-20b tokenizer (counting instruction+input+output)