New face video driving sample

#19
by Magico666999 - opened

Hi, do you know where I can download other videos with facial expressions like the samples already present?

Kuaishou Visual Generation and Interaction Center org

Emmm, from web, tiktok or recording by yourself : ) @Magico666999

I've already tried but it doesn't seem to work. Is there a guide to create videos with the right settings?

you can download tiktok video with downloader tiktok video website that you find easily googling it then you use another website to crop this video to 1:1 in order to get a working driving video in live portrait

main issues is that tiktok video show people moving a lot their body and their head so it won't work properly. You have to browse and find video where people only do facial mimics without moving their head to have good driving video that will give good results

you have other websites where you can find facial mimics to find driving video like istock or getty videos but you will have to find video where body and head and camera doesnt move for best result

I think the best option is to make video shot with your own webcam in order to make driving video.

Or you can wait the improvement of the application when the author will integrate head, body and camera movement for driving video but i think it will be a complex task before managing to do it

thanks! then I wait new improvements!

Actually it's not that difficult, but you need to use software to extract videos and edit them (you can find these online). First, find a video (on youtube, tiktok, whatever) that you want to use. Keep in mind that you only need an extract where the face is looking directly at the camera and the shot must be stable during the extract you'll use (stabilizing software can help with this, but it has limits). Then, edit the video so that: 1) the format is 1:1 (square); 2) the first frame has a neutral expression, with eyes open and mouth shut (this is by far the most important factor); 3) the video can't be much longer than 1 minute; 4) the face occupies a significant part of the frame (you can crop the video yourself).

If you do all this, the driving video will work like a charm.

Oh yes. Also keep in mind that the shoulder movement in the driving video must be minimal, and that it is better if the face does not move too much towards or away from the camera (otherwise, in the final video the head will change size in a somewhat unnatural way).

Sign up or log in to comment