jiachenli-ucsb
commited on
Commit
•
e065a02
1
Parent(s):
8568851
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,55 @@
|
|
1 |
-
---
|
2 |
-
license: cc-by-4.0
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-4.0
|
3 |
+
---
|
4 |
+
|
5 |
+
# <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span>: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedback
|
6 |
+
|
7 |
+
## 4-step Text-to-video Generation
|
8 |
+
|
9 |
+
<table class="center">
|
10 |
+
<td>
|
11 |
+
<video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0273.mp4" type="video/mp4"></video>
|
12 |
+
</td>
|
13 |
+
<td>
|
14 |
+
<video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0054.mp4" type="video/mp4"></video>
|
15 |
+
</td>
|
16 |
+
<td>
|
17 |
+
<video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0262.mp4" type="video/mp4"></video>
|
18 |
+
</td>
|
19 |
+
|
20 |
+
<tr>
|
21 |
+
<td style="text-align:center;" width="320">With the style of low-poly game art, A majestic, white horse gallops gracefully across a moonlit beach.</td>
|
22 |
+
<td style="text-align:center;" width="320">medium shot of Christine, a beautiful 25-year-old brunette resembling Selena Gomez, anxiously looking up as she walks down a New York street, cinematic style</td>
|
23 |
+
<td style="text-align:center;" width="320">a cartoon pig playing his guitar, Andrew Warhol style</td>
|
24 |
+
<tr>
|
25 |
+
</table >
|
26 |
+
|
27 |
+
<table class="center">
|
28 |
+
<td>
|
29 |
+
<video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0023.mp4" type="video/mp4"></video>
|
30 |
+
</td>
|
31 |
+
<td>
|
32 |
+
<video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0021.mp4" type="video/mp4"></video>
|
33 |
+
</td>
|
34 |
+
<td>
|
35 |
+
<video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0064.mp4" type="video/mp4"></video>
|
36 |
+
</td>
|
37 |
+
|
38 |
+
<tr>
|
39 |
+
<td style="text-align:center;" width="320">a dog wearing vr goggles on a boat</td>
|
40 |
+
<td style="text-align:center;" width="320">Pikachu snowboarding</td>
|
41 |
+
<td style="text-align:center;" width="320">a girl floating underwater </td>
|
42 |
+
<tr>
|
43 |
+
</table >
|
44 |
+
|
45 |
+
## Model description 🚀
|
46 |
+
|
47 |
+
This repository contains `unet_lora.pt` that can turn [VideoCrafter2](https://ailab-cvc.github.io/videocrafter2/) into our <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span> (VC2). Our <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span> (VC2) can achieve both fast and high-quality T2V generation. On [VBench](https://vchitect.github.io/VBench-project/), the 4-step generation from our <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span> (VC2) even outperform proprietary systems, including [Gen-2](https://research.runwayml.com/gen2) and [Pika](https://pika.art/). Please refer to our [GitHub repo](https://github.com/Ji4chenLi/t2v-turbo) for detailed instructions.
|
48 |
+
|
49 |
+
|
50 |
+
## Misuse, Malicious Use and Excessive Use 📖
|
51 |
+
Our model is meant for research purposes.
|
52 |
+
|
53 |
+
- It is prohibited to generate content that is demeaning or harmful to people or their environment, culture, religion, etc.
|
54 |
+
- Prohibited for pornographic, violent and bloody content generation.
|
55 |
+
- Prohibited for error and false information generation.
|