| language: | |
| - en | |
| library_name: transformers | |
| license: cc-by-4.0 | |
| tags: | |
| - auto-gptq | |
| - AutoRound | |
| extra_gated_prompt: This model is exclusively available to paid subscribers of [The | |
| Kaitchup](https://kaitchup.substack.com/). To gain access, [subscribe to The Kaitchup](https://kaitchup.substack.com/) | |
| for either a monthly or yearly paid plan. Once subscribed, you will receive an access | |
| token by email and will have access to all the models listed on [this page](https://kaitchup.substack.com/p/models). | |
| ## Model Details | |
| This is [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) quantized with AutoRound and serialized with the GPTQ format in 4-bit. The model has been created, tested, and evaluated by The Kaitchup. | |
| Details on the AutoRound quantization process and how to use the model here: | |
| [Intel AutoRound: Accurate Low-bit Quantization for LLMs](https://kaitchup.substack.com/p/intel-autoround-accurate-low-bit) | |
| - **Developed by:** [The Kaitchup](https://kaitchup.substack.com/) | |
| - **Language(s) (NLP):** English | |
| - **License:** cc-by-4.0 | |