File size: 2,352 Bytes
e31fdb3 6273798 e31fdb3 a6ad059 e31fdb3 a6ad059 e31fdb3 a6ad059 e31fdb3 a6ad059 e31fdb3 a6ad059 e31fdb3 a6ad059 e31fdb3 a6ad059 e31fdb3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
---
license: creativeml-openrail-m
---
## FRANKENWEIGHTS
dunh dunh dunh...
You wouldn't think something like this might work, but it does. I took the text encoder from my "Storytime" model
and then blindly pasted it over the text encoder stuff in the SD 1.5 model and now we have ![FrankenWeights](/FrankenWeights.safetensors)
It's ALIVE!!!:
![](Examples/FrankenPosition.PNG)
Also included here is a somewhat "refined" version of the "Superposition" ComfyUI workflow called ![Frankenposition](Frankenposition.json) This includes
the extra awesomesauce done by ByteDance with their work on ![Hyper-SD](https://huggingface.co/ByteDance/Hyper-SD/blob/main/README.md) and their
![Lora](https://huggingface.co/ByteDance/Hyper-SD/blob/main/Hyper-SD15-8steps-CFG-lora.safetensors) for SD1.5 models, which allows you to greatly reduce the steps required to produce an image --
![](Examples/StarryWarry2.PNG)
Frakenweights in this context responds best to "normal" CFG ranges (5-8), especially with the Lora linked above. I generally
like to make things that will take a huge range of CFG values, but in this case everything hums along together so well
for my purposes that I'm not gonna mess with a good thing. We hack stuff and just try things in these parts, and it
just so happens that the combo of FrankenWeights, that Lora, and the "Superposition" bits make a truly Frank-en Stein
with enough ummph to bring all your wild ideas to life:
![](Examples/Starrywarry_00263_.png)
![](Examples/Starrywarry_00020_.png)
![](Examples/Starrywarry_00062_.png)
![](Examples/Starrywarry_00166_.png)
![](Examples/Starrywarry_00226_.png)
(all of the above come from the same prompts and settings)
So, get your grubby little hands (I'm sure space aliens consider us to be "grubby" and "little") on FrankenWeights today.
I have intentionally left this as a 32 bit model, because more often than not the "burn" in an image can be stretched
like tasty taffy back into reasonable colors using various image editing things like Photoshop. 32 bits per pixel gives
a _huge_ range of latitude for adjusting colors in such programs. I imagine most colorists would be in heaven if there
was some video codec that could work at 32 bits. So, welcome to, uh, "heaven" and go to town on even your burnt images
because there's all sorts of latitude with 32 bits.
|