language:en region:us
---
language:
- en
dataset_info:
  features:
  - name: topic
    dtype: string
  - name: model
    dtype: string
  - name: concepts
    sequence: string
  - name: outline
    sequence: string
  - name: markdown
    dtype: string
  splits:
  - name: train
    num_bytes: 471931604
    num_examples: 11650
  download_size: 0
  dataset_size: 471931604
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---
# Dataset Card for "textbook_quality_programming"

Synthetic programming textbooks generated with GPT-3.5 and retrieval.  Very high quality, aimed at being used in a phi replication.  Currently 115M tokens.  Covers many languages and technologies, with a bias towards python.

~10k of the books (65M tokens) use an older generation method, and average 6k tokens in length.  ~1.5k books (50M tokens) use a newer generation method, with a more detailed outline, and average 33k tokens in length.  All books have section headers for optimal chunking.

Generated using the [textbook_quality](https://github.com/VikParuchuri/textbook_quality) repo.