task_categories:conversational task_categories:question-answering task_categories:text-generation size_categories:1M<n<10M language:en language:zh license:openrail region:us
---
license: openrail
task_categories:
- conversational
- question-answering
- text-generation
language:
- en
- zh
size_categories:
- 1M<n<10M
---
## This dataset is a version of the ChatCombined dataset where each token is separated into three different columns.
These three columns are:
- "System" - a string with a system prompt
- "User" - a string with user input
- "Assistant" - a string containing the model output

# You can load the dataset like this
```python
with open("formatted_data.json") as f:
    data = json.load(f)
val_data = data["validation"]
data = data["train"]
```
### Example usage
```python
def __getitem__(self, idx):
        system = self.data[idx]["System"].strip('\n')
        user = self.data[idx]["User"].strip('\n')
        assistant = self.data[idx]["Assistant"].strip('\n')
        return system, user, assistant
```
## Citations
```
@misc{huggingface2023,
title={dmayhem93/ChatCombined},
author={{dmayhem93}},
year=2023,
url="https://huggingface.co/datasets/dmayhem93/ChatCombined"
}
```