|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
--- |
|
|
|
<p align="center"> |
|
🔗 <a href="https://rhymes.ai/" target="_blank"> Try Aria!</a> · 📖 <a href="https://www.rhymes.ai/blog-details/aria-first-open-multimodal-native-moe-model" target="_blank">Blog</a> · 📌 <a href="https://arxiv.org/pdf/2410.05993" target="_blank">Paper</a> |
|
· ⭐<a href="https://github.com/rhymes-ai/Aria" target="_blank">GitHub</a> |
|
</p> |
|
|
|
# Gallery |
|
<img src="https://huggingface.co/rhymes-ai/Allegro/resolve/main/gallery.gif" width="1000" height="800"/>For more demos and corresponding prompts, see the [Allegro Gallery](TBD). |
|
|
|
|
|
# Key Feature |
|
Allegro is capable of producing high-quality, 6-second videos at 30 frames per second and 720p resolution from simple text prompts. |
|
- xxx |
|
- xxx |
|
- xxx |
|
|
|
# Model info |
|
|
|
| **Model** | Allegro | |
|
|-------------------------------|------------------------------------------------| |
|
| **Description** | Text-to-Video Diffusion Transformer | |
|
| **Download** | <HF link - TBD> | |
|
| **Parameter** | VAE: 175M<br>DiT: 2.8B | |
|
| **Inference Precision** | VAE: FP32/TF32/BF16/FP16 (best in FP32/TF32)<br>DiT/T5: BF16/FP32/TF32 | |
|
| **Context Length** | 79.2k | |
|
| **Resolution** | 720 x 1280 | |
|
| **Frames** | 88 | |
|
| **Video Length** | 6 seconds @ 15 fps | |
|
| **Single GPU Memory Usage** | 9.3G BF16 (with cpu_offload) | |
|
|
|
| Name | Parameter | Context Length | Download | |
|
|-----------|-----------|-----------------|------------------------------------------------------------------| |
|
| Allegro | 3B | 80K | [🤗 Hugging Face](https://huggingface.co/rhymes-ai/Allegro) | |
|
| | |
|
|
|
# Quick start |
|
|
|
# License |
|
This repo is released under the Apache 2.0 License. |
|
|
|
# Disclaimer |
|
The Allegro models are provided on an "AS IS" basis, and we disclaim any liability for consequences or damages arising from your use. Users are kindly advised to ensure compliance with all applicable laws and regulations. This includes, but is not limited to, prohibitions against illegal activities and the generation of content that is violent, pornographic, obscene, or otherwise deemed non-safe, inappropriate, or illegal. By using these models, you agree that we shall not be held accountable for any consequences resulting from your use. |
