Update README.md

c0d6d40 verified 2 months ago

12.5 kB

	---
	license: cc-by-nc-3.0
	language:
	- en
	tags:
	- art
	- roleplay
	- preset
	- presets
	- sillytavern
	- silly tavern
	- template
	- prompt
	base_model:
	- mistralai/Mistral-Nemo-Instruct-2407
	- mistralai/Mistral-Small-Instruct-2409
	- TheDrummer/Rocinante-12B-v1.1
	- TheDrummer/Cydonia-22B-v1
	- TheDrummer/Theia-21B-v2
	- MarinaraSpaghetti/NemoMix-Unleashed-12B
	- anthracite-org/magnum-v2-12b
	- anthracite-org/magnum-v3-34b
	- Sao10K/Fimbulvetr-11B-v2
	- Sao10K/L3-8B-Stheno-v3.2
	- nothingiisreal/MN-12B-Celeste-V1.9
	- nothingiisreal/L3.1-8B-Celeste-V1.5
	---
	<p align="justify">Simple, effective, universal presets for Silly Tavern role-playing purposes. Organized file names, organized preset names, detailed instruction and explanations.<br><br><b>SillyTavern (Version):</b> 1.12.6+<br><b>Templates (Included):</b> Mistral, ChatML, LLAMA3, Alpaca, Metharme/Pygmalion<br><b>Models (Suggested):</b> a) Mistral Nemo - Instruct (12B); b) Mistral Small - Instruct (22B); c) Magnum V2/V.3 (12B/34B); d) Rocinante (12B); e) Nemo Unleashed by Marinara (12B); f) ArliRPG Models (12B/22B); g) Theia (21B); h) Cydonia (22B); i) Celeste 1.5/1.9 (8B/12B); j) Stheno 3.2 (8B), k) Silicon/Loyal Macaroni/Kunoichi Maids (7B), l) any other models using those exact templates</p>
	<br>
	<div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">
	> Match <b>CONTEXT TEMPLATE</b> & <b>INSTRUCT TEMPLATE</b> (by names - while loading them up in Silly Tavern UI) [<u>"CAPITAL A" - SETTINGS TAB</u>].<br>> Switch <b>1st/3rd Person</b> LLM Narration through <b>SYSTEM PROMPT</b> (start new chat to be sure that it works) [<u>"CAPITAL A" - SETTINGS TAB</u>].<br>> Switch <b>CONVERSATION/ROLEPLAY/STORY</b> LLM responses style & <b>MODEL'S CREATIVITY</b> through <b>SAMPLERS</b> [<u>"SLIDERS" - SETTINGS TAB</u>].
	</div>
	<br>
	<h1><ins><b><i>Don't be the Amazon's Saur-off. Be a true Lord of the Templates.</i></b></ins></h1>

	![image/png](https://images-wixmp-ed30a86b8c4ca887773594c2.wixmp.com/f/2dfb4db0-369a-4282-8429-c8a46d46de35/d8dyoyz-8815376a-1e6e-4198-b095-be03c05e3e86.png/v1/fill/w_1600,h_900,q_80,strp/one_ring_to_rule_them_all_by_selrond_d8dyoyz-fullview.jpg?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJ1cm46YXBwOjdlMGQxODg5ODIyNjQzNzNhNWYwZDQxNWVhMGQyNmUwIiwiaXNzIjoidXJuOmFwcDo3ZTBkMTg4OTgyMjY0MzczYTVmMGQ0MTVlYTBkMjZlMCIsIm9iaiI6W1t7ImhlaWdodCI6Ijw9OTAwIiwicGF0aCI6IlwvZlwvMmRmYjRkYjAtMzY5YS00MjgyLTg0MjktYzhhNDZkNDZkZTM1XC9kOGR5b3l6LTg4MTUzNzZhLTFlNmUtNDE5OC1iMDk1LWJlMDNjMDVlM2U4Ni5wbmciLCJ3aWR0aCI6Ijw9MTYwMCJ9XV0sImF1ZCI6WyJ1cm46c2VydmljZTppbWFnZS5vcGVyYXRpb25zIl19.92FhR88NPBUuGjCRD5alt3zZ6wUav0pY9SFymqhcG18)\|
	\|:--:\|
	\|Creative Commons Attribution-NonCommercial-ShareAlike 3.0 License (https://www.deviantart.com/selrond/art/One-Ring-To-Rule-Them-All-507183083)\|<br>

	<br>
	<h1><ins>FILES (.JSON) INCLUDED:</ins></h1>
	<li>CONTEXT TEMPLATES (STORY STRING)</li>
	<li>INSTRUCT TEMPLATES</li>
	<li>SYSTEM PROMPTS</li>
	<li>SETTINGS (SAMPLERS)</li>
	<br>
	<h1><ins>SAMPLERS (USED):</ins></h1>
	<li>Temperature</li>
	<li>Min-P</li>
	<li>DRY (prevents repetition)</li>
	<br>
	> All the other samplers neutralized. That's all you need in modern times (2024/2025).<br>> I am not a fan of XTC, it feels too "loose".
	<br>
	<br>
	<h5><b>CREATIVITY VARIANTS:</b></h5>
	<div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">
	<li><b>Sphiratrioth [T=0.7] (Temperature = 0.7)</b> - less creative responses, more precise, tames down the "fidgeting" models</li>
	<li><b>Sphiratrioth [T=1.0] (Temperature = 1.0)</b> - standard, balanced responses, works well with a majority of modern models</li>
	<li><b>Sphiratrioth [T=0.7] (Temperature = 1.3)</b> - creative boost - but without going off the rails, which starts around T=1.5</li>
	</div>
	<br>
	<h5><b>MESSAGES FORMATS:</b></h5>
	<div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">
	<li><b>1st Person / 3rd Person</b> (switch through System Prompt Presets!)</li>
	<li><b>DIALOGUES</b> - plain text, no quotation marks, it's a bother</li>
	<li><b>NARRATION</b> - italics</li>
	<li><b>Trim Incomplete Sentences: ON</b> (it prevents messeges from being cut in half with short maximum tokens setting in "conversation" mode preset)</li>
	</div><br>
	<h5><b>PRESETS:</b></h5>
	<div style="background-color: #ffefb8; padding: 16px 32px; outline: 2px solid; border-radius: 10px;">

	A) Sphiratrioth (Conversation) - minimal narration - when you want to simulate a natural, human-like conversation with a bot. For those who do not like the "verbose" role-play.
	*<<< conversation-like, ~ 150 tokens responses, mostly dialogues with basic narration when needed, it works well >>>*

	![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/FcqkVZc0iqEgcoyHzdxxn.png)

	B) Sphiratrioth (Roleplay) - balanced RP - when you want to experience a balanced role-play with responses around 1-2 paragraphs.
	*<<< 1 short paragraph, ~ 250 tokens responses, around 1/3 dialogues against 2/3 narration >>>*

	![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/xpHm-GAGFw9Yd8L7NHEih.png)

	C) Sphiratrioth (Story) - AI becomes your Game Master (GM) - when you want those long, verbose paragraphs with rich narration & story-telling.
	*<<< 1-3 paragraphs, ~ 350 tokens responses, around 50/50 narration against dialogues, pushes the story on its own >>>*

	![image/png](https://cdn-uploads.huggingface.co/production/uploads/66a2a6820c4cd36ffbc95623/NA7o-KgqTYv7fDXLnSy07.png)

	</div>
	<br>
	<h1><ins>How to use:</ins></h1>

	Advanced Users: Enjoy, modify, forget.\
	Beginners: Read further.

	1. Find your model's native INSTRUCT TEMPLATE. Every fine-tune stands on a base model, which is usually specified by its creator in a manner of "We're presenting the first fine-tune of Mistral Small" or "Nemo on steroids" or "LLAMA 3 with our special sauce" etc. It may be confusing, it may be clear. Not my fault :-P However, you need to identify the base model of a fine-tune by reading its description page. Different templates may be used by creators (tuners) for training - and then - templates suggested on a fine-tune's page work best. However, creators often just choose the basic template of a model they're tuning - so make sure to check the model's description page or assume it's using the base model's template (template of the main model that a given tuner is tuning).
	*<<< Most typical templates: Mistral, ChatML, LLAMA3, Alpaca, Metharme/Pygmalion >>>*
	2. Golden Rule: Match CONTEXT TEMPLATE (Story String) and INSTRUCT TEMPLATE with your model. For instance, when Mistral-Nemo fine-tune is using the Mistral Instruct Template (as specified by creator of a fine-tune) - pick up the "Sphiratrioth - Mistral [CONTEXT TEMPLATE]" file and "Sphiratrioth - Mistral [INSTRUCT TEMPLATE]" file. It's very easy. I keep my naming clear - both the file names and preset names inside of the Silly Tavern UI list when you load them up. They're always clear and distinguishable.
	*<<< This rule may be broken when you become the advanced user. Then, you'll know what you're doing so you'll mix different context/instruct templates. For now - one ring... khem - one template to rule them all. Don't be the Amazon Saur-off. Be a true Lord of the Templates.>>>*/
	3. Download my presets.
	4. Copy the [Sphiratrioth-(...)-CONTEXT TEMPLATE] files to (...)\SillyTavern\data\default-user\context.
	5. Copy the [Sphiratrioth-(...)-INSTRUCT TEMPLATE] files to (...)\SillyTavern\data\default-user\instruct.
	6. Copy the [Sphiratrioth-(...)-SETTINGS] files to SillyTavern\data\default-user\TextGen Settings.
	7. Copy the [Sphiratrioth-(...)-PROMPT] files to (...)\SillyTavern\data\default-user\sysprompt.
	8. Open up Silly Tavern UI.
	9. Click on the "Capital A" tab in Silly Tavern UI (AI Response Formatting).
	10. Load up my Context Template (Story String) Preset from the Context Templates list.
	11. Click on the "Enable Instruct Mode" button (ON/OFF next to the name "Instruct Template").
	12. Load up my Instruct Template Preset from the Instruct Templates list.
	13. Load up my System Prompt from the System Prompts list.
	14. Click on the "Sliders" tab in Silly Tavern UI (AI Response Configuration).
	15. Load up my Settings Preset from the Text Completion Presets list.
	16. Switch between the 1st Person/3rd Person narration by switching the System Prompt Presets. Theoretically, it should re-evaluate the prompt but it may not work unless you start a new chat!
	17. Switch between Conversation/Roleplay/Story Modes & Creativity (Temperature) by switching the Settings (Text Completion Presets/Samplers).
	18. Enjoy.
	<br>
	<br>
	<h1><ins>BEWARE:</ins></h1>

	<p align="justify">IF YOU WANT THE PRESETS TO WORK PROPERLY, REMEMBER TO START A NEW CHAT FOR TESTING PURPOSES/ACTUAL ROLEPLAY. IF YOU "HOT" SWAP THE PRESETS, YOU MAY EASILY FALL INTO A TRAP OF CONTINUING THE PREVIOUS PROMPT. IN RESULT, THE SHORT/BALANCED/LONG RESPONSES AND NARRATION IN 1st/3rd PERSON WILL NOT SWITCH PROPERLY. ALWAYS START A NEW CHAT. THEORETICALLY, SWITCHING A SYSTEM PROMPT FORCES THE PROMPT EVALUATION BUT IN REALITY - IT OFTEN BREAKS, IT DOES NOT WORK PROPERLY. IT WORKS WHEN YOU START A NEW CHAT THOUGH - OR WHEN YOU RELOAD THE WHOLE SILLY TAVERN UI.</p>

	<h1><ins>CUSTOMIZATION:</ins></h1>
	<li>Dialogues in Markdowns - modify the SYSTEM PROMPT ("Capital A" tab of Silly Tavern UI). It's simple - find the following line and replace with: Respect this markdown format: "direct speech", actions</li>
	<li>Narration in Plain Text - modify the SYSTEM PROMPT ("Capital A" tab of Silly Tavern UI). Find the following line and replace with: Respect this markdown format: "direct speech", actions</li>
	<li>Shorter/Longer Replies (additional ways of setting it up): a) character example messages - this helps a lot; b) shorter/longer starting message; c) OOC - check what's that, some models support it well - such as Celeste</li>
	<br>
	<h1><ins>PLANS FOR THE FUTURE:</ins></h1>
	<li>Maybe switching narration type and messages formatting from System Prompt to Context Template</li>
	<br>
	<h1><ins>ANNOTATIONS:</ins></h1>

	I am using the full names of what's what but people simplify - thus - you'll come across the words context & instruct meaning different things in the community. No one bothers themselves with writing context template vs context length or instruct template vs instruct mode/instruct model. Everyone simply says context & instruct, throws in story string (since it's clear it is a part of the context template, isn't it? Isn't?!). It all causes confusion for beginners. Here - a small guide for you - to understand how others operate. Here, all is clearly names so it won't be needed.
	<br>
	<li>Context = Context Template = Story String (IN TERMS OF PRESETS)</li>
	I'm simplifying here but people often get confused with names. Story String is a part of the Context Template - to be precise - but creators of models and presets use those terms as equivalents...
	<li>Context = Context Length of a model (IN TERMS OF PROPER USE OF A WORD). People simplify and use mental leaps. Not my fault, again :-P</li>
	<li>Instruct = Instruct Template (IN TERMS OF PROPER USE OF A WORD). Again, people simplify...</li>
	<li>Model Name - Instruct Model = a model trained to follow instructions in a given instruct template (IN TERMS OF PROPER USE OF A WORD). You catch the drill by now, don't you? :-P</li>
	<br>
	There are other great presets from Virt-io or Marinara available on the site but they come with messy preset names, less clear file structures or forced instructions such as including the character example messages through instruct/context template, which becomes the unnecessary bother. Importing those presets into Silly Tavern requires a bit of work and deeper understanding - you need to manually change the presets names in JSON files to something recognizable/useful, do the same with file names to understand what's what on the long Silly Tavern lists when loading the presets up etc.<br><br>Both Marinara and Virt-AI are great creators so when you learn and understand how presets actually work - be sure to give their presets collections a try! :-)

	<a id="1">[1]</a> : Virt-io, [Silly Tavern Presets](https://huggingface.co/Virt-io/SillyTavern-Presets), 2024

	<a id="1">[2]</a> : Marinara, [Silly Tavern Presets](https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings), 2024