task_categories:text-generation size_categories:n<1K language:en fine-tuning shakespeare region:us
---
task_categories:
- text-generation
language:
- en
tags:
- fine-tuning
- shakespeare
size_categories:
- n<1K
---
# Data source
Downloaded via Andrej Karpathy's nanogpt repo from this [link](https://raw.githubusercontent.com/karpathy/char-rnn/master/data/tinyshakespeare/input.txt)

# Data Format
- The entire dataset is split into train (90%) and test (10%).
- All rows are at most 1024 tokens, using the Llama 2 tokenizer.
- All rows are split cleanly so that sentences are whole and unbroken.