Update README.md
Browse files
README.md
CHANGED
@@ -5,9 +5,25 @@ license: apache-2.0
|
|
5 |
|
6 |
These are model weights originally provided by the authors of the paper [T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations](https://arxiv.org/abs/2301.06052).
|
7 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
8 |
<figure>
|
9 |
<img src="https://huggingface.co/vumichien/T2M-GPT/resolve/main/demo_slow1.gif" alt="Demo Slow", width="425", height=480/>
|
10 |
<figcaption> a man starts off in an up right position with botg arms extended out by his sides, he then brings his arms down to his body and claps his hands together. after this he wals down amd the the left where he proceeds to sit on a seat
|
11 |
</figcaption>
|
12 |
</figure>
|
13 |
|
|
|
|
|
|
5 |
|
6 |
These are model weights originally provided by the authors of the paper [T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations](https://arxiv.org/abs/2301.06052).
|
7 |
|
8 |
+
<figure>
|
9 |
+
<img src="https://huggingface.co/vumichien/T2M-GPT/resolve/main/Teaser.png" alt="T2M-GPT">
|
10 |
+
<figcaption>Audio-visual HuBERT
|
11 |
+
</figcaption>
|
12 |
+
</figure>
|
13 |
+
|
14 |
+
Conditional generative framework based on Vector QuantisedVariational AutoEncoder (VQ-VAE) and Generative Pretrained Transformer (GPT) for human motion generation
|
15 |
+
from textural descriptions.
|
16 |
+
|
17 |
+
A simple CNN-based VQ-VAE with commonly used training recipes (EMA and Code Reset) allows us to obtain high-quality discrete representations
|
18 |
+
|
19 |
+
The official code of this paper in [here](https://github.com/Mael-zys/T2M-GPT)
|
20 |
+
|
21 |
+
## Example
|
22 |
<figure>
|
23 |
<img src="https://huggingface.co/vumichien/T2M-GPT/resolve/main/demo_slow1.gif" alt="Demo Slow", width="425", height=480/>
|
24 |
<figcaption> a man starts off in an up right position with botg arms extended out by his sides, he then brings his arms down to his body and claps his hands together. after this he wals down amd the the left where he proceeds to sit on a seat
|
25 |
</figcaption>
|
26 |
</figure>
|
27 |
|
28 |
+
## Datasets
|
29 |
+
HumanML3D and KIT-ML
|