|
--- |
|
library_name: transformers |
|
license: apache-2.0 |
|
base_model: |
|
- grimjim/Llama-3.1-SuperNova-Lite-lorabilterated-8B |
|
tags: |
|
- generated_from_trainer |
|
datasets: |
|
- Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned |
|
- anthracite-org/stheno-filtered-v1.1 |
|
- PJMixers/hieunguyenminh_roleplay-deduped-ShareGPT |
|
- Gryphe/Sonnet3.5-Charcard-Roleplay |
|
- Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned |
|
- anthracite-org/kalo-opus-instruct-22k-no-refusal |
|
- anthracite-org/nopm_claude_writing_fixed |
|
- anthracite-org/kalo_opus_misc_240827 |
|
model-index: |
|
- name: Epiculous/NovaSpark |
|
results: [] |
|
--- |
|
### exl2 quant (measurement.json in main branch) |
|
--- |
|
### check revisions for quants |
|
--- |
|
|
|
|
|
 |
|
|
|
Switching things up a bit since the last slew of models were all 12B, we now have NovaSpark! NovaSpark is an 8B model trained on GrimJim's [abliterated](https://huggingface.co/grimjim/Llama-3.1-SuperNova-Lite-lorabilterated-8B) version of arcee's [SuperNova-lite](https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite). |
|
The hope is abliteration will remove some of the inherant refusals and censorship of the original model, however I noticed that finetuning on GrimJim's model undid some of the abliteration, therefore more than likely abiliteration will have to be reapplied to the resulting model to reinforce it. |
|
|
|
# Quants! |
|
[full](https://huggingface.co/Epiculous/NovaSpark) / <strong>exl2</strong> / [gguf](https://huggingface.co/Epiculous/NovaSpark-GGUF) |
|
|
|
## Prompting |
|
This model is trained on llama instruct template, the prompting structure goes a little something like this: |
|
|
|
``` |
|
<|begin_of_text|><|start_header_id|>system<|end_header_id|> |
|
|
|
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|> |
|
|
|
{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|> |
|
``` |
|
|
|
### Context and Instruct |
|
This model is trained on llama-instruct, please use that Context and Instruct template. |
|
|
|
### Current Top Sampler Settings |
|
[Smooth Creativity](https://files.catbox.moe/0ihfir.json): Credit to Juelsman for researching this one!<br/> |
|
[Variant Chimera](https://files.catbox.moe/h7vd45.json): Credit to Numbra!<br/> |
|
[Spicy_Temp](https://files.catbox.moe/9npj0z.json) <br/> |
|
[Violet_Twilight-Nitral-Special](https://files.catbox.moe/ot54u3.json) <br/> |
