Edit model card

Caution: This model may output adult content.

FISH - Fusion of Intuitive Semantic Heuristics

For this model I took the following LoRAs

SeanWu25/Mixtral_8x7b_Medicine

SeanWu25/Mixtral_8x7b_WuKurtz

and

wandb/Mixtral-8x7b-Remixtral

And merged them onto their base model.

I then did a simple linear merge between them, an experimental unreleased 8x7B model, and an unreleased model that was a intermediate step in creating Envoid/BondBurger-8x7B

The end results are a surprisingly good model for role palying style entertainment.

At first I was disappointed with the results but ended up settling on the following sampler parameters which really bring it to life.

It does eccentuate characters that have particularly aggressive personalities.

Because this is part of the whole SensualNousInstruct family of models it still suffers from the same tokenizer/special tokens weirdness.

This model has only been tested in Q8 GGUF form due to hardware limitations.

It responds well to [INST] do a thing [/INST] instruct style formatting (although uses the ChatML special tokens)

Downloads last month
26
Safetensors
Model size
46.7B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Envoid/Fish-8x7B

Quantizations
2 models