region:us
# pythia-12b-neuron-dataset-examples

This dataset contains the top 64 highest activating dataset examples for each
MLP neuron in Pythia-12b. The dataset examples are all 16 tokens long. See
https://confirmlabs.org/posts/dreaming.html for details.

Columns:
- `layer`: the layer of the neuron
- `neuron`: the index of the neuron
- `rank`: the rank of the example
- `activation`: the activation of the neuron on the example
- `position`: the token position for which the neuron is maximally activated.
- `text`: the text of the example: `tokenizer.decode(ids[:, :position+1])`
- `id#`: the token id at position `#` in 0 to 15.