jiachenli-ucsb commited on
Commit
e065a02
•
1 Parent(s): 8568851

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -3
README.md CHANGED
@@ -1,3 +1,55 @@
1
- ---
2
- license: cc-by-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ ---
4
+
5
+ # <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span>: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedback
6
+
7
+ ## 4-step Text-to-video Generation
8
+
9
+ <table class="center">
10
+ <td>
11
+ <video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0273.mp4" type="video/mp4"></video>
12
+ </td>
13
+ <td>
14
+ <video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0054.mp4" type="video/mp4"></video>
15
+ </td>
16
+ <td>
17
+ <video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0262.mp4" type="video/mp4"></video>
18
+ </td>
19
+
20
+ <tr>
21
+ <td style="text-align:center;" width="320">With the style of low-poly game art, A majestic, white horse gallops gracefully across a moonlit beach.</td>
22
+ <td style="text-align:center;" width="320">medium shot of Christine, a beautiful 25-year-old brunette resembling Selena Gomez, anxiously looking up as she walks down a New York street, cinematic style</td>
23
+ <td style="text-align:center;" width="320">a cartoon pig playing his guitar, Andrew Warhol style</td>
24
+ <tr>
25
+ </table >
26
+
27
+ <table class="center">
28
+ <td>
29
+ <video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0023.mp4" type="video/mp4"></video>
30
+ </td>
31
+ <td>
32
+ <video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0021.mp4" type="video/mp4"></video>
33
+ </td>
34
+ <td>
35
+ <video poster="" autoplay controls muted loop height="150%" playbackRate=2.0><source src="https://rg-lcd.s3.amazonaws.com/t2v-turbo-demo/t2v-turbo-vc2/4steps/0064.mp4" type="video/mp4"></video>
36
+ </td>
37
+
38
+ <tr>
39
+ <td style="text-align:center;" width="320">a dog wearing vr goggles on a boat</td>
40
+ <td style="text-align:center;" width="320">Pikachu snowboarding</td>
41
+ <td style="text-align:center;" width="320">a girl floating underwater </td>
42
+ <tr>
43
+ </table >
44
+
45
+ ## Model description 🚀
46
+
47
+ This repository contains `unet_lora.pt` that can turn [VideoCrafter2](https://ailab-cvc.github.io/videocrafter2/) into our <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span> (VC2). Our <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span> (VC2) can achieve both fast and high-quality T2V generation. On [VBench](https://vchitect.github.io/VBench-project/), the 4-step generation from our <span style="font-family: 'Courier New', monospace; font-weight: bold">T2V-Turbo</span> (VC2) even outperform proprietary systems, including [Gen-2](https://research.runwayml.com/gen2) and [Pika](https://pika.art/). Please refer to our [GitHub repo](https://github.com/Ji4chenLi/t2v-turbo) for detailed instructions.
48
+
49
+
50
+ ## Misuse, Malicious Use and Excessive Use 📖
51
+ Our model is meant for research purposes.
52
+
53
+ - It is prohibited to generate content that is demeaning or harmful to people or their environment, culture, religion, etc.
54
+ - Prohibited for pornographic, violent and bloody content generation.
55
+ - Prohibited for error and false information generation.