Update README.md
Browse files
README.md
CHANGED
@@ -66,7 +66,7 @@ library_name: diffusers
|
|
66 |
</tr>
|
67 |
<tr>
|
68 |
<th>Video Length</th>
|
69 |
-
<td>6 seconds @ 15
|
70 |
</tr>
|
71 |
<tr>
|
72 |
<th>Single GPU Memory Usage</th>
|
@@ -78,21 +78,22 @@ library_name: diffusers
|
|
78 |
# Quick start
|
79 |
1. Download the [Allegro GitHub code](https://github.com/rhymes-ai/Allegro).
|
80 |
2. Install the necessary requirements.
|
81 |
-
a. Ensure Python >= 3.10, PyTorch >= 2.4, CUDA >= 12.4. For details, see [requirements.txt](https://github.com/rhymes-ai/Allegro/blob/main/requirements.txt).
|
82 |
b. It is recommended to use Anaconda to create a new environment (Python >= 3.10) to run the following example.
|
83 |
-
|
84 |
-
|
85 |
-
|
86 |
-
python
|
87 |
-
|
88 |
-
--
|
89 |
-
--
|
90 |
-
--
|
91 |
-
--
|
92 |
-
--
|
93 |
-
--
|
94 |
-
--
|
95 |
-
|
|
|
96 |
|
97 |
# License
|
98 |
This repo is released under the Apache 2.0 License.
|
|
|
66 |
</tr>
|
67 |
<tr>
|
68 |
<th>Video Length</th>
|
69 |
+
<td>6 seconds @ 15 FPS</td>
|
70 |
</tr>
|
71 |
<tr>
|
72 |
<th>Single GPU Memory Usage</th>
|
|
|
78 |
# Quick start
|
79 |
1. Download the [Allegro GitHub code](https://github.com/rhymes-ai/Allegro).
|
80 |
2. Install the necessary requirements.
|
81 |
+
a. Ensure Python >= 3.10, PyTorch >= 2.4, CUDA >= 12.4. For details, see [requirements.txt](https://github.com/rhymes-ai/Allegro/blob/main/requirements.txt).
|
82 |
b. It is recommended to use Anaconda to create a new environment (Python >= 3.10) to run the following example.
|
83 |
+
4. Download the [Allegro model weights](https://huggingface.co/rhymes-ai/Allegro).
|
84 |
+
5. Run inference.
|
85 |
+
|
86 |
+
```python
|
87 |
+
python single_inference.py \
|
88 |
+
--user_prompt 'A seaside harbor with bright sunlight and sparkling seawater, with many boats in the water. From an aerial view, the boats vary in size and color, some moving and some stationary. Fishing boats in the water suggest that this location might be a popular spot for docking fishing boats.' \
|
89 |
+
--vae your/path/to/vae \
|
90 |
+
--dit your/path/to/transformer \
|
91 |
+
--text_encoder your/path/to/text_encoder \
|
92 |
+
--tokenizer your/path/to/tokenizer \
|
93 |
+
--guidance_scale 7.5 \
|
94 |
+
--num_sampling_steps 100 \
|
95 |
+
--seed 42
|
96 |
+
```
|
97 |
|
98 |
# License
|
99 |
This repo is released under the Apache 2.0 License.
|