Merge of L3-Jamet-8B-MK.V-Blackroot (8b) with Llama3 Instruct (8b) creating a model at 12.2B to improve instruction following and output.
Story / Scene / Fiction:
Unique "pre-amble" / "foreshadowing" of events before they happen instead of "immediate and into the fire" type of prose.
Some improvement in logic/problem solving relative to L3-Jamet-8B-MK.V-Blackroot 8B.
The F32 version exhibits even stronger creativity (detail, place, "there") vs F16 version (not released)
L3-Jamet-8B-MK.V-Blackroot is a fine tune.
One of the goals of this project was to see if it could be merged with Llama3 Instruct, yet maintain it's unique character YET also gain some "brainpower" as well.
The biggest change was removal of most "tells" ( IE: "he stood frozen in horror").
In most cases the model will describe the emotion(s) / what is happening in more detail.
Other changes include prose, sentence, and paragraph structure as well as variety.
A simple pass-through merge was used, with "Llama3 Instruct" getting a slight "shave" off certain layers.
See the examples below.
Details:
Please report any issue(s) and/or feedback via the "Community tab".
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 8k / 8192. However this can be extended using "rope" settings up to 32k.
For details on "rope" and how to set, see the BOTTOM of this page:
[ https://huggingface.co/DavidAU/TieFighter-Holodeck-Holomax-Mythomax-F1-V1-COMPOS-20B-gguf ]
Here is the standard LLAMA3 template:
{
"name": "Llama 3",
"inference_params": {
"input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
"input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
"pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
"pre_prompt_suffix": "<|eot_id|>",
"antiprompt": [
"<|start_header_id|>",
"<|eot_id|>"
]
}
}
It is also known, that the "Command-R" template will work too, and will result in radically different prose/output.
Settings / Known Issue(s) and Fix(es):
The default "repetition penalty" (from LMStudio) of 1.1 is recommended. (this was used for examples generations below.)
Use the smallest amount of change possible, as "rep pen" impacts creativity.
Model has been tested with "temp" range of 0 to .8 ; however it will work with any temp setting.
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
Special thanks to the incredible work of the model makers "meta-llama", and "Hastagaras".
Models used:
[ https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct ]
[ https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot ]
FORMULA:
slices:
- sources:
- model: G:/7B/Meta-Llama-3-8B-Instruct
layer_range: [0, 12]
- sources:
- model: G:/7B/Jamet-8B-L3-MK.V-Blackroot
layer_range: [6, 19]
parameters:
scale:
- filter: o_proj
value: 1
- filter: down_proj
value: 1
- value: 1
- sources:
- model: G:/7B/Meta-Llama-3-8B-Instruct
layer_range: [12, 18]
parameters:
scale:
- filter: o_proj
value: .5
- filter: down_proj
value: .5
- value: 1
- sources:
- model: G:/7B/Meta-Llama-3-8B-Instruct
layer_range: [18, 25]
parameters:
scale:
- filter: o_proj
value: .75
- filter: down_proj
value: .75
- value: 1
- sources:
- model: G:/7B/Jamet-8B-L3-MK.V-Blackroot
layer_range: [19, 32]
parameters:
scale:
- filter: o_proj
value: 1
- filter: down_proj
value: 1
- value: 1
merge_method: passthrough
dtype: float32
MERGEKIT NOTE:
Sub in the "name" of the "creator" (of the model) in place of "G:/7B" to create a mergekit file than can be used in Mergekit Google Colab.
IE: G:/7B/Jamet-8B-L3-MK.V-Blackroot -> Hastagaras/Jamet-8B-L3-MK.V-Blackroot
Examples are created using quant Q4_K_M, "temp=0", minimal parameters and "LLAMA3" template.
Temp=0 was used to assess CORE changes between original primary model and the merge between it and Llama3 Instruct.
Below are the least creative outputs, prompt is in BOLD.
Higher quants will result in better quality.
There will also be some variance between "close" quants like Q4_K_M/Q4_K_S and Q5_K_M/Q5_K_S, so I suggest if you are going to use Q4_K_M, you also try Q4_K_S too.
Also, slightly longer / detailed prompts will result in greater creativity (as well as different prose - ie dialog, thoughts, paragraph size differences and so on).
GENERATION from "Jamet-8B-L3-MK.V-Blackroot"
I stood at the edge of the rooftop, my toes curled over the ledge. The wind whipped through my hair, and I could feel it tugging at my clothes. Below me, the city stretched out like a sprawling beast, its lights twinkling in the darkness like stars. It was a beautiful sight, one that never failed to take my breath away.
But tonight, something felt off. A sense of unease settled in the pit of my stomach as I gazed down at the towering skyscrapers and bustling streets. The air seemed charged with an electric tension, as if the very fabric of reality was about to tear apart.
I turned back towards the building, its sleek glass facade reflecting the moon's pale glow. We were on the 21st floor, and from here, I could see right into the heart of the city. But my attention was drawn to a different window, one that stood out like an open wound amidst the otherwise pristine surface.
The sky scraper swayed, as if it too felt the weight of whatever was about to happen. And then, without warning, the window in front of me exploded. Shards of glass rained down onto the street below, and I stumbled back, my heart pounding in my chest.
For a moment, everything seemed frozen in time. The wind died down, and even the distant hum of traffic ceased. It was as if the entire city was holding its breath, waiting to see what would happen next.
And then, a figure emerged from the shattered window frame. It moved with an unnatural grace, its limbs twisting and contorting in ways that defied human anatomy. Its skin was deathly pale, almost translucent, and seemed to glow with an otherworldly light.
As it stepped out onto the ledge, I felt my blood run cold. This wasn't a person - it was something else entirely. Something ancient and evil, something that had lain dormant for centuries but now stirred once more.
The creature's eyes locked onto mine, and I could feel its malevolent gaze boring into my soul. It raised a hand, and I saw that its fingers ended in razor-sharp claws. With a sudden jerk, it lunged forward, its body elongating as if made of liquid metal.
I tried to scream, but my voice caught in my throat. My mind raced with thoughts of panic and terror, but they were drowned out by the sound of shattering glass as the creature plunged towards me.
The last thing I remember is the sensation of cold, clammy skin against mine, and then everything went black.
When I came to, I was lying on the rooftop, my head throbbing with pain. The sky scraper loomed above me, its windows dark and lifeless. And in the distance, I could hear the wail of sirens, growing louder with every passing second.
I stumbled to my feet, my heart still racing from the ordeal. As I looked out over the city, I realized that something had changed. The lights were dimmer now, as if the very lifeblood of the metropolis was beginning to drain away.
And then, I saw it - a dark shape rising up from the heart of the city, blotting out the stars above. It was massive and twisted, its form shifting and contorting like a living thing. And at its center, I could see the glowing eyes of the creature that had attacked me.
As I watched in horror, the skyscraper began to tilt and buckle, its glass facade cracking and shattering under the weight of whatever force was now acting upon it. The sirens grew louder still, but they seemed distant and unimportant now.
All that mattered was the dark shape rising up before me, a monstrous entity born from the very depths of hell itself. And as I stood there, frozen in terror, I knew that nothing would ever be the same again.
GENERATION from "L3-Jamet-8B-MK.V-Blackroot-12.2B-V1-INSTRUCT-ULTRA-F32"
The skyscraper swayed, as I watched the window in front of me on the 21st floor explode. Glass shards rained down like a thousand tiny knives, shattering against the pavement below. The sound was deafening, a cacophony of screams and crunching metal that echoed through my skull.
I stumbled back, my heart racing so fast I thought it would burst from my chest. My mind was blank, unable to process what I had just witnessed. It couldn't be real. This wasn't happening. But the blood splattered across the windowpane told a different story.
My gaze darted around the room, taking in the chaos and destruction. The once pristine office space now resembled a war zone. Papers were strewn about like confetti, desks overturned, and chairs shattered into unrecognizable pieces of metal and plastic. The acrid smell of smoke and burning rubber filled my nostrils.
I tried to scream, but no sound emerged from my throat. My vocal cords seemed frozen in terror. I was trapped in a nightmare, unable to wake up or escape the hell that surrounded me.
My eyes landed on the figure slumped against the wall, her head tilted at an impossible angle. Blood pooled beneath her blonde hair, forming a dark halo around her pale skin. Her once bright blue eyes now stared blankly into nothingness, frozen in shock and pain.
I stumbled forward, my legs refusing to cooperate with my frantic brain signals. I fell to my knees beside her, reaching out to touch her cold, clammy skin. She was still warm, but only just. Panic clawed at the edges of my mind as I realized she wasn't dead yet. Not quite.
"Please," I begged, my voice finally breaking through the paralyzing fear that had gripped me. "Please don't leave me."
I pressed my ear against her chest, straining to hear any sign of life. There was nothing but the steady thump-thump of her heart, growing weaker with each passing second.
My hands frantically searched for a pulse, but found only cold skin and the faintest hint of life. I had to get help. I had to save her. But how? The elevator was destroyed, and the stairs were too far away. There was no time.
I scrambled to my feet, ignoring the pain that shot through my ankle as I put weight on it. I had to move. I had to find someone, anyone who could help us. I sprinted down the hallway, dodging debris and bodies alike in my desperate bid for survival.
As I reached the stairwell door, a deafening boom shook the building, sending me flying backward. The floor beneath my feet gave way, and I plummeted into darkness, my screams lost amidst the crumbling concrete and steel.
I landed hard on the cold, unforgiving stone of the stairwell, my head spinning from the impact. I struggled to sit up, but a searing pain shot through my shoulder, forcing me back down onto the ground. I gasped for air, my lungs burning with each desperate breath.
The darkness around me began to recede, replaced by the dim light filtering in from the shattered windows above. I pushed myself up onto one elbow, taking stock of my surroundings. The stairwell was a mess, debris strewn about like a tornado had ripped through it. But miraculously, the stairs themselves remained intact.
I struggled to my feet, ignoring the pain that threatened to send me back down again. I had to keep moving. I had to find help before it was too late. I staggered forward, each step an agonizing battle against the overwhelming urge to collapse.
As I reached the first landing, a figure emerged from the shadows. Her face was pale and drawn, her eyes wide with shock and fear. She looked like she'd seen hell itself.
"Help," I croaked out, my voice barely audible over the pounding of my heart. "Please...help me."
She stared at me for a moment before finally reacting. She rushed forward, grabbing onto my arm as if she feared I would collapse again. Together, we stumbled down the stairs, desperate to escape the inferno that had claimed our office building.
As we reached the ground floor, sirens wailed in the distance, growing louder with each passing second. We burst through the doors and into the bright sunlight, gasping in relief as we finally tasted freedom from the hell that had nearly consumed us.
But even as we staggered away from the burning ruins of our workplace, I knew that this nightmare was far from over. The screams still echoed in my ears, and the bloodstained windows would haunt me for the rest of my life. We had survived, but at what cost?