|
--- |
|
base_model: meta-llama/Llama-3.2-90B-Vision-bnb-4bit |
|
language: |
|
- en |
|
library_name: transformers |
|
license: llama3.2 |
|
tags: |
|
- llama-3 |
|
- llama |
|
- meta |
|
- facebook |
|
- osllmai |
|
- transformers |
|
--- |
|
|
|
|
|
**osllm.ai Models Highlights Program** |
|
|
|
**We believe there's no need to pay a token if you have a GPU on your computer.** |
|
|
|
Highlighting new and noteworthy models from the community. Join the conversation on Discord. |
|
|
|
|
|
**Model creator**: Llama-3.2-90B-Vision-bnb-4bit |
|
**Original model**: Meta LLAMA 3.2 |
|
|
|
|
|
<p align="center"> |
|
<a href="https://osllm.ai">Official Website</a> • <a href="https://docs.osllm.ai/index.html">Documentation</a> • <a href="https://discord.gg/2fftQauwDD">Discord</a> |
|
</p> |
|
|
|
|
|
|
|
<p align="center"> |
|
<b>NEW:</b> <a href="https://docs.google.com/forms/d/1CQXJvxLUqLBSXnjqQmRpOyZqD6nrKubLz2WTcIJ37fU/prefill">Subscribe to our mailing list</a> for updates and news! |
|
</p> |
|
|
|
|
|
Email: [email protected] |
|
|
|
|
|
|
|
**Acknowledgments** |
|
Our sincere gratitude to the Meta and Llama teams for their efforts in developing and releasing these models. |
|
|
|
**Model Overview** |
|
The Meta Llama 3.2 collection features multilingual large language models (LLMs), available in 1B and 3B sizes, with capabilities in both text input and output. The instruction-tuned Llama 3.2 models are optimized for multilingual dialogue, excelling in agentic retrieval and summarization tasks. They demonstrate superior performance on standard industry benchmarks compared to many open-source and closed chat models. |
|
|
|
- **Developer**: Meta |
|
- **Architecture**: Llama 3.2 is an auto-regressive language model utilizing an optimized transformer structure. Its tuned versions employ supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety. |
|
- **Supported Languages**: Officially supported languages include English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Llama 3.2 has been trained on a wider array of languages, and developers may further fine-tune the model for additional languages, subject to the Llama 3.2 Community License and Acceptable Use Policy. Responsible and safe deployment practices are required. |
|
- **Token Counts**: Token references pertain solely to pretraining data. All versions employ Grouped-Query Attention (GQA) to enhance inference scalability. |
|
|
|
**Release Information** |
|
- **Release Date**: September 25, 2024 |
|
- **Status**: This is a static model based on an offline dataset. Future updates may further enhance model performance and safety. |
|
- **License**: Llama 3.2 usage is governed by the Llama 3.2 Community License, [a custom commercial license agreement](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/LICENSE). |
|
|
|
**Feedback and Further Information** |
|
For questions or feedback regarding Llama 3.2, please refer to the model README. Additional technical details and guidance on generation parameters, as well as usage recipes, can be found [here](https://github.com/meta-llama/llama-recipes). |
|
|
|
|
|
**Disclaimers** |
|
|
|
[osllm.ai](https://osllm.ai) is not the creator, originator, or owner of any Model featured in the Community Model Program. |
|
Each Community Model is created and provided by third parties. osllm.ai does not endorse, support, represent, |
|
or guarantee the completeness, truthfulness, accuracy, or reliability of any Community Model. You understand |
|
that Community Models can produce content that might be offensive, harmful, inaccurate, or otherwise |
|
inappropriate, or deceptive. Each Community Model is the sole responsibility of the person or entity who |
|
originated such Model. osllm.ai may not monitor or control the Community Models and cannot, and does not, take |
|
responsibility for any such Model. osllm.ai disclaims all warranties or guarantees about the accuracy, |
|
reliability, or benefits of the Community Models. osllm.ai further disclaims any warranty that the Community |
|
Model will meet your requirements, be secure, uninterrupted, or available at any time or location, or |
|
error-free, virus-free, or that any errors will be corrected, or otherwise. You will be solely responsible for |
|
any damage resulting from your use of or access to the Community Models, your downloading of any Community |
|
Model, or use of any other Community Model provided by or through [osllm.ai](https://osllm.ai). |
|
|