|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- cogvideox |
|
- video-generation |
|
- image-to-video |
|
- diffusers |
|
--- |
|
|
|
# cogvideox-2b-img2vid |
|
|
|
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/8vOYgS-Wm51BgOKv4Jnpp.mp4"></video> |
|
|
|
### ComfyUI Example |
|
<p> |
|
<img src="cogvideox-2b-img2vid-workflow.png" width="800" height="400" title="preview"/> |
|
</p> |
|
<p> |
|
<a href="cogvideox-2b-img2vid-workflow.json">JSON Workflow Example</a> |
|
</p> |
|
ComfyUI custom node can be found <a href="https://github.com/Nim-Video/ComfyUI-CogVideoXWrapper">here</a>. |
|
|
|
### How to |
|
Clone repo |
|
```bash |
|
git clone https://github.com/Nim-Video/cogvideox-2b-img2vid.git |
|
cd cogvideox-2b-img2vid |
|
``` |
|
|
|
Create venv |
|
```bash |
|
python -m venv venv |
|
source venv/bin/activate |
|
``` |
|
|
|
Install requirements |
|
```bash |
|
pip install -r requirements.txt |
|
``` |
|
|
|
### Simple examples |
|
#### Inference with cli |
|
```bash |
|
python -m inference.cli_demo \ |
|
--video_path "resources/truck.jpg" \ |
|
--prompt "A truck is driving through a dirt road, showcasing its capability for off-roading." \ |
|
--model_path NimVideo/cogvideox-2b-img2vid |
|
``` |
|
|
|
#### Inference with Gradio |
|
```bash |
|
python -m inference.gradio_web_demo \ |
|
--model_path NimVideo/cogvideox-2b-img2vid |
|
``` |
|
|
|
## Acknowledgements |
|
Original code and models [CogVideoX](https://github.com/THUDM/CogVideo/tree/main). |
|
|
|
|