Create README.md

README.md

@@ -0,0 +1,50 @@
+---
+license: apache-2.0
+language:
+- en
+library_name: transformers
+tags:
+- multimodal
+- aria
+---
+<p align="center">
+  <br>Aria</br>
+</p> 
+
+<p align="center">
+🔗 <a href="https://huggingface.co" target="_blank"> Try Aria!</a> · 📖 <a href="https://huggingface.co" target="_blank">Blog</a> · 📌 <a href="https://huggingface.co" target="_blank">Paper</a> ·
+ ·🖤 <a href="https://huggingface.co" target="_blank">GitHub</a>  💜 <a href="https://huggingface.co" target="_blank">Discord</a>
+· 💙 <a href="https://huggingface.co" target="_blank">Twitter</a>
+</p> 
+
+# Highlights
+
+- Aria is the **first open multimodal native MoE** model, capable of seamlessly handling various input modalities within a MoE architecture.
+- Aria performs **on par with GPT-4o mini and Gemini 1.5 Flash** across a range of multimodal tasks while maintaining strong performance on **text**-only tasks.
+- Compared to similar or even larger models, Aria boasts **faster speeds** and **lower costs**. This high efficiency stems from its ability to activate only 3.9B parameters during inference – the **fewest** among models with comparable performance.
+
+# Key features
+
+- **Robust multimodal understanding**: Aria processes various input modalities, including video, images, code, and text. It demonstrates strong performance across diverse downstream tasks such as long-context video and image understanding and OCR. Moreover, it excels in instruction following.
+- **Flexible image handling**: Aria supports variable image sizes and aspect ratios while maintaining high quality.
+- **Extended context capacity**: Aria can manage multiple images within a long context window of 64k tokens.
+- **Advanced text understanding**: Aria demonstrates competitive performance across language and coding tasks.
+
+# Model Info
+
+| Model  | Download  | Parameter | Context Length |
+| :---- | :------- | :------------ | :------ |
+| Aria | < HF link - TBD> | • Activation: 3.9B (3.5B MoE + 0.4B Visual Encoder) <br> • Total: 25.3B | 64K           |
+
+# Benchmark
+
+
+
+# Quick Start
+
+
+
+
+# License
+
+This repo is released under the Apache 2.0 License.