What are the options when hitting GPU limits?

#22
by mixer28 - opened

Is there an upgrade option if you hit the render/ GPU limit?
The render speed is very fast ( very fast) and the app/ tech is amazing!
When I do 2-3 short 15-20 sec clips, I hit a timeout and have to stop for 10-30 mins etc
Is there a way to pay to upgrade to keep LP working?
I have a test demo project I am working on and I have about 14-15 images/ scenes which would need 2-3 renders of each clip to get roughly where I want.
I cut all my driver clips into 15-20 seconds, hoping it would be manageable, but I keep getting timeouts every 2-3 renders.
Ideally like to be able to keep LivePortrait going. I would be happy to pay for the GPU time if its reasonably priced :)
Many thanks LP for your cool video Ai technology!

Kuaishou Visual Generation and Interaction Center org

Thanks for your attention and kind word of LivePortrait. @mixer28

The current implementation is not optimzied, it does not recommend recording long videos (e.g., several minutes) as it may cause memory overflow.

As for upgrade option:

The first way, you may need to buy the GPU hours, e.g., referring to https://huggingface.co/pricing
The second way, you can try to build Gradio or run LivePortrait locally: https://github.com/KwaiVGI/LivePortrait, and read readme carefully. Several community resources are also there: https://github.com/KwaiVGI/LivePortrait?tab=readme-ov-file#community-resources-

Hope these information help you. And it's a little hard to prepare a good driving video, you can refer to the guide!

Thank you for getting back to me.
I installed it locally using Pinokio.
It renders output video very fast.
All the driving videos I made worked well - even when they were shot low res, on a webcam, on a phone, or with not very good lighting.
Video renders at a rate of around 4-5 seconds for each 1 second of inputted video, on a consumer level Nvidia 3060 GPU ( 12Gb).
LivePortrait does not overheat my GPU too much either.
It is very good code you guys have written!
Thanks :)

mixer28, the gpu limits are also bottlenecking my projects. Would you please tell a complete novice how to run Live Portrait in Pinokio, step by step?

Download Pinokio - https://pinokio.computer/
Watch the YouTube video on the homepage, then install it (Warning: the drive space needed is quite bit, maybe 30-40Gb).
Once installed run it and Live Portrait should show as one of the apps in the interface.
Click and install LP (through Pinokio interface).
To use LP, you start the Pinokio App as a framework, then you run Live portrait inside it.

Thanks for the step-by-step. I've done this. But when I run Live Portrait within Pinokio, I don't see where to upload the media (portrait, driving video, etc.). Instead I see a page of Nvidia ads. I must just be missing it, if you can help guide me to it.

Sign up or log in to comment