license:openrail region:us
---
license: openrail
dataset_info:
  features:
  - name: id
    dtype: int32
  - name: header
    dtype: string
  - name: story
    dtype: string
  splits:
  - name: everything
    num_bytes: 4112502210
    num_examples: 52357
  download_size: 2446111268
  dataset_size: 4112502210
---

this is a testing dataset for future model testing. you should not use this (yet)

there are multiple datasets,
* `notebook_defaults`
* `notebook_defaults_ratio0.8_likes10`

you can load each like this:

```python
import datasets
# see FFV4.BUILDER_CONFIGS for all possible names
ds = datasets.load_dataset('./dataset_code.py', name='notebook_defaults_ratio0.8_likes10')
```

then use them like this
```python
ds_real = ds['everything'] # there is no such thing as a train/test split here
one_item = ds_real[0] # grab first story, and truncuate the text of it to first 1000 characters
one_item_truncuated = one_item | {'story': one_item['story'][:1000]}

print(ds)
print(one_item_truncuated)
```

this will show something vaguely useful 

```python
DatasetDict({
    everything: Dataset({
        features: ['id', 'header', 'story'],
        num_rows: 52357
    })
})
{'id': 394130, 'header': '<|info|>\ntitle: Broken, But Getting Better\nauthor: Rose Quill\ntags: character:Tempest Shadow, character:Twilight Sparkle, genre:Slice of Life, series:My Little Pony: Friendship is Magic', 'story': "=== Broken ===\nI stared at the paper, a pencil in my mouth as I considered the next words. I was not the most well read of ponies, having always taken the stance that actions speak louder, but I felt that this time needed some words to explain. I scanned what I had already written to try and jog my vocabulary.\nPrincess Twilight,\nBy the time you read this, I'll have left. I know you offered me your friendship, but I think it would do me well to be apart from other ponies for a few days…give or take a week.\nThis is not running away, no. Far from it. I have been away from my kind for so long I fear I have forgotten what it means to even be Equestrian. I need time to observe with no metric standing against me.\nI sighed and glanced out the window at the town of Ponyville, the town square filled with banners and other evidence of an upcoming party. In the glass of the portal, I saw the snapped stub of my horn, and I felt the dull pain that I had lived with for most of my life.\nI reached up a"}
```
