Spaces:
Running
on
Zero
A cartoony face (how to improve)
I'm just overwelmed with this tool! It's an absolute insane and powerful and opens a huge perspective to not mems and jokes (which are sure cool too) but it is also very useful for serious ideas and projects and your work is priceless!
Though I tried to work with a stylized characters as there is an example of a cartoony stylized one in the presets. But unfortunately there was no success (see pic below) - the project doesn't recognize the face of such character. But! I made an experiment and tried about 15 different characters and there is a possibility to animate even highly stylized characters like anime and charicatures. Could you please explain how can i help the algorithm to "see" the face of my character? Should I try to add a more
or less realistic nose and ears to "complete" the face? Do you have in plans to expand your project so it should work with such type of characters? Maybe with semi-auto technique like when you manually pick the face parts to help to rotoscope them for the algorithm. Anyway thank you very much for your efforts and your great project!
Okey, I tried myself to make it work... Here's what i made for the model. But even now it doesn't work and the AI doesn't recognize the face :(
For example. This one works. Not perfectly but it does its work.
One more example. This one works almost perfectly
Even this one works.... There is almost No difference now in this face and in mine "creature" but mine doesn't work yet :(
I did it! It worked when I put the MOUTH lower and at more natural height regarding to the proportions of the head.
Now i'll try to find maybe it is the only thing that I had to do?
And we are almost there! I have only lowered the mouth. But this one was not enough. But when i added the nose it worked! Everything else was left untouched. I haven't removed the leaves and the stem, I haven't added the ears! I haven't changed the skin to a human-like and i even haven't closed the eyelids or moved the eyebrows! Now i'll try to modify the nose so it looked more suitable for the character while testing the picture with the AI.
And I think here we are!
It's fun! A related issue is here: https://github.com/KwaiVGI/LivePortrait/issues/119. One can use X-Pose for better detection for non-real-human faces. @SlayeR-FCSM