|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- cogvideox |
|
- video-generation |
|
- image-to-video |
|
- diffusers |
|
--- |
|
|
|
|
|
# π₯ CogVideoX-2B-Img2Vid π |
|
|
|
### Fine-tuned on 10 million videos for high-quality generation at SBS levels comparable to CogVideoX-5B! π |
|
|
|
|
|
# Model Highlights π |
|
|
|
- Fine-tuned on 10 million videos for exceptional image-to-video generation quality. |
|
|
|
- Performance benchmarked to match SBS standards at CogVideoX-5B i2v level. |
|
|
|
|
|
## Usage Examples π₯ |
|
|
|
### Try it for free on [nim.video](https://nim.video) |
|
|
|
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/8vOYgS-Wm51BgOKv4Jnpp.mp4"></video> |
|
|
|
### CLI Inference π |
|
```bash |
|
python -m inference.cli_demo \ |
|
--video_path "resources/truck.jpg" \ |
|
--prompt "A truck is driving through a dirt road, showcasing its capability for off-roading." \ |
|
--model_path NimVideo/cogvideox-2b-img2vid |
|
|
|
``` |
|
## Gradio Inference with Web Demo π₯οΈ |
|
```bash |
|
python -m inference.gradio_web_demo \ |
|
--model_path NimVideo/cogvideox-2b-img2vid |
|
``` |
|
### ComfyUI Example π‘ |
|
|
|
<p align="center"> |
|
<img src="cogvideox-2b-img2vid-workflow.png" width="800" height="400" alt="Workflow Preview" title="Workflow Example Preview"/> |
|
</p> |
|
<p align="center"> |
|
<a href="cogvideox-2b-img2vid-workflow.json">π JSON Workflow Example</a> |
|
</p> |
|
|
|
|
|
### π§ [Find the custom ComfyUI node here.](https://github.com/Nim-Video/ComfyUI-CogVideoXWrapper) |
|
|
|
## Quick Start π |
|
|
|
1οΈβ£ Clone the Repository |
|
```bash |
|
git clone https://github.com/Nim-Video/cogvideox-2b-img2vid.git |
|
cd cogvideox-2b-img2vid |
|
``` |
|
2οΈβ£ Set up a Virtual Environment |
|
```bash |
|
python -m venv venv |
|
source venv/bin/activate |
|
``` |
|
3οΈβ£ Install Requirements |
|
```bash |
|
pip install -r requirements.txt |
|
``` |
|
|
|
## Acknowledgements π |
|
|
|
This project builds on the foundational work of [CogVideoX](https://github.com/THUDM/CogVideo/tree/main). |
|
|
|
|