How do I generate a longer video?

#2
by NeuralFalcon - opened

For example, I provide an image, input.png, and it generates a 2-second video, temp.mp4. My goal is to generate a 4-second video. I extracted the last frame of temp.mp4, saved it as input_1.png, and passed it to the model. It returned temp2.mp4, but the second video still has no movement. I found out that temp.mp4 has movement, but temp2.mp4 has no movement—it's just a still image, the same as the last frame. Why can't it generate movement after the first time?

Why can't it generate a video(with movement) from the last frame of the output video?

NeuralFalcon changed discussion title from how to generate longer video ? to How do I generate a longer video?

This kind of autoregressive generation is the easiest way to generate growth videos, and usually, the results are not very good. You can generate it a few more times in the second phase, and you should get good results. Modifying the corresponding prompt in the second phase should also help.

NeuralFalcon changed discussion status to closed

Sign up or log in to comment