task_categories:text-generation size_categories:100K<n<1M language:en license:apache-2.0 region:us
---
dataset_info:
  features:
  - name: instruction
    dtype: string
  - name: context
    dtype: string
  - name: response
    dtype: string
  - name: category
    dtype: string
  splits:
  - name: train
    num_bytes: 405052984.34317416
    num_examples: 257307
  - name: validation
    num_bytes: 3935502.9628340285
    num_examples: 2500
  download_size: 235552617
  dataset_size: 408988487.30600816
license: apache-2.0
task_categories:
- text-generation
language:
- en
size_categories:
- 100K<n<1M
---
# Dataset Card for "dolly-self-instr-oasst1-OIG-sharegpt-dolly_format"

### This dataset is created to do less context-dependent tuning. Open-endess Focused.

### This dataset combines the following HF datasets with filters:
- Dolly (only keeping those without context, no close QA, summarization, extraction)
- Self-instruct (only human created ones)
- oasst1
- OIG 3 subsets for Koala
- sharegpt (only keeping those with instructions that have more than 10 words after splitting by space)