SinGAN GIF: Learning a Generative Video Model from a Single GIF
We propose SinGAN GIF, an extension of the image based SinGAN [27] to GIFs or short video snippets. Our method learns the distribution of both the image patches in the GIF as well as their motion patterns. We do so by using a pyramid of 3D and 2D convolutional networks to model temporal information while reducing model parameters and training time, along with an image and a video discriminator. SinGAN GIF can generate similar looking video samples for natural scenes at different spatial resolutions or temporal frame rates, and can be extended to other video applications like video editing, super resolution, and motion transfer. The project page, with supplementary video results, is: https:/rajat95.github.io/singan gif/
2021 IEEE Winter Conference on Applications of Computer Vision (WACV)