I get always a "overfitted" model?

#52
by eicu - opened

Hi,

yesterday i have trained a few models for a person with a collection of 10-20 photos, i always get a model that generate photos of this person no matter what I enter as prompt, e.g. i typed in the prompt: "a horse on the moon", i get this result (for privacy reason i have mask the the face of this person):
huggingface.jpg

I have trained a new model with this person in different options an i always get the "same" result. For comparison I have trained one model with colab of LastBen with the same input, and with this trained model i get the following result with the same prompt
lastben_colab.png

I have trained a few other models with this space before, which worked out well. I then reproduced this method and since yesterday I also get such a "broken" model.

Any ideas what goes wrong?

I had the same thing happen. I've trained about 30 models that all turned out well, but both models yesterday did not.

Thanks for flagging. Weird to see a change in behavior given the code / dependencies did not change. I will try to replicate and get back to you

Running into the same issue since yesterday, model were fine and now appears like OP without a code change

I have exactly the same problem. Tried multiple trainings with different base models. They all just reproduce the input images.

Same issue here

This comment has been hidden

Also having the same issue.

Same issue :)

I'm only now realizing, after a couple of days of withdrawal, how seriously addicted I've become to this :)

same issue. Model seems overfitted.

Hi everyone! The 0.36.0 version of the bitsandbytes dependency seem to have broken the training process. I have pinned the 0.35.x version and that seem to have fixed it! Please duplicate the Space and try again. Here it is working as before!

This comment has been hidden

Hi everyone! The 0.36.0 version of the bitsandbytes dependency seem to have broken the training process. I have pinned the 0.35.x version and that seem to have fixed it! Please duplicate the Space and try again. Here it is working as before!

works for me, thanks.

Works again for me too, thank you!

Seems like 1.5 is not overfitting anymore, but trying 2.17... is still overfitting any models I try on it. I have not tried the other 2.15 model yet so I can't state on it either way.

multimodalart changed discussion status to closed

Sign up or log in to comment