Model Card for Model ID
This is the quantized version of Llama3.1-8B using bitsandbytes
. More quantized LLMs coming soon...
Model Description
- Developed by: Meta
- Quantized by: Akshath Mangudi
- My GitHub: https://github.com/akshathmangudi
- My LinkedIn: https://www.linkedin.com/in/akshathmangudi/
- License: llama3.1
Model Source
- Downloads last month
- 32
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.