flux 4B version

#1
by ayahareedy - opened

Are there any plans to release a 4B version?

are there any plans to release a 12B version?

are there any plans to unrelease this version?

do we need all the blocks cant we compress the blocks into fewer blocks while predicting the same weights etc, iam sure theres some technic for it

Are there any plans to release a 4B version?

We are working on making available for 24Gb VRAM GPUs, without modifying weights precision.

We are working on making available for 24Gb VRAM GPUs, without modifying weights precision.

do try more prompt variety and maybe using other data rather than flux outputs , it can collapse training a model on its own outputs

also a 4-8 step destil lora would be cool too

jamarju-fp changed discussion status to closed

Sign up or log in to comment