
# ScarletPajama

Introducing ScarletPajama: a language model that has been finetuned on the ShareGPT dataset. Built upon the robust RedPajama-INCITE-Chat-3b architecture. <br>
The original ShareGPT dataset consisted of 53k pairs of conversational exchanges. In order to optimize the training process, the dataset was converted to the appropriate format and filtered to remove long texts. The resulting filtered version of ShareGPT contains 22k pairs, ensuring a more focused and efficient training process.


## Model Details

- **Model Name**: ScarletPajama
- **Base Model**: RedPajama-INCITE-Chat-3b
- **Dataset**: <a href="https://huggingface.co/datasets/Fredithefish/ShareGPT-Unfiltered-RedPajama-Chat-format/blob/main/ShareGPT-22k.jsonl">ShareGPT-22K</a>
- **Fine-tuning Epochs**: 2
{"license": "apache-2.0", "inference": false}
transformers pytorch gpt_neox text-generation license:apache-2.0 autotrain_compatible has_space text-generation-inference region:us
TAGS
#transformers #pytorch #gpt_neox #text-generation #license-apache-2.0 #autotrain_compatible #has_space #text-generation-inference #region-us 


# ScarletPajama

Introducing ScarletPajama: a language model that has been finetuned on the ShareGPT dataset. Built upon the robust RedPajama-INCITE-Chat-3b architecture. <br>
The original ShareGPT dataset consisted of 53k pairs of conversational exchanges. In order to optimize the training process, the dataset was converted to the appropriate format and filtered to remove long texts. The resulting filtered version of ShareGPT contains 22k pairs, ensuring a more focused and efficient training process.


## Model Details

- Model Name: ScarletPajama
- Base Model: RedPajama-INCITE-Chat-3b
- Dataset: <a href="URL
- Fine-tuning Epochs: 2
# ScarletPajama

Introducing ScarletPajama: a language model that has been finetuned on the ShareGPT dataset. Built upon the robust RedPajama-INCITE-Chat-3b architecture. <br>
The original ShareGPT dataset consisted of 53k pairs of conversational exchanges. In order to optimize the training process, the dataset was converted to the appropriate format and filtered to remove long texts. The resulting filtered version of ShareGPT contains 22k pairs, ensuring a more focused and efficient training process. ## Model Details

- Model Name: ScarletPajama
- Base Model: RedPajama-INCITE-Chat-3b
- Dataset: <a href="URL
- Fine-tuning Epochs: 2
TAGS
#transformers #pytorch #gpt_neox #text-generation #license-apache-2.0 #autotrain_compatible #has_space #text-generation-inference #region-us 
 # ScarletPajama

Introducing ScarletPajama: a language model that has been finetuned on the ShareGPT dataset. Built upon the robust RedPajama-INCITE-Chat-3b architecture. <br>
The original ShareGPT dataset consisted of 53k pairs of conversational exchanges. In order to optimize the training process, the dataset was converted to the appropriate format and filtered to remove long texts. The resulting filtered version of ShareGPT contains 22k pairs, ensuring a more focused and efficient training process. ## Model Details

- Model Name: ScarletPajama
- Base Model: RedPajama-INCITE-Chat-3b
- Dataset: <a href="URL
- Fine-tuning Epochs: 2