region:us
---
dataset_info:
  features:
  - name: topic
    dtype: string
  - name: model
    dtype: string
  - name: concepts
    dtype: string
  - name: outline
    dtype: string
  - name: markdown
    dtype: string
  - name: field
    dtype: string
  - name: subfield
    dtype: string
  - name: rag
    dtype: string
  splits:
  - name: train
    num_bytes: 397014633
    num_examples: 1795
  download_size: 134557403
  dataset_size: 397014633
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---

## Textbooks Are All You Need

Leveraging Large Language Models (LLMs), there's an opportunity to create a comprehensive open-source repository reminiscent of the historic Library of Alexandria.

This initiative represents a preliminary attempt at producing high-quality books covering an extensive range of subjects. The source of these samples varies:

- Some generated using the RAG model, referencing Wikipedia or other search data.
- Some are completely synthetically generated.
- Some created using GPT-3.5 and others with GPT-4.

### Generation:
- **[Textbook Quality](https://github.com/VikParuchuri/textbook_quality)**: 1391 samples & ~48M tokens of serp RAG programming texts
- **[SciPhi](https://github.com/emrgnt-cmplxty/SciPhi)**: 300 samples & ~38M tokens of wikipedia RAG + full synthetic general textbooks

For a comprehensive view, explore our collection on GitHub: **[Library of Phi](https://github.com/emrgnt-cmplxty/library_of_phi)**.

---