metadata
language:
- en
library_name: transformers
license: cc-by-4.0
tags:
- auto-gptq
- AutoRound
extra_gated_prompt: >-
This model is exclusively available to paid subscribers of [The
Kaitchup](https://kaitchup.substack.com/). To gain access, [subscribe to The
Kaitchup](https://kaitchup.substack.com/) for either a monthly or yearly paid
plan. Once subscribed, you will receive an access token by email and will have
access to all the models listed on [this
page](https://kaitchup.substack.com/p/models).
Model Details
This is meta-llama/Meta-Llama-3-8B quantized with AutoRound and serialized with the GPTQ format in 4-bit. The model has been created, tested, and evaluated by The Kaitchup.
Details on the AutoRound quantization process and how to use the model here: Intel AutoRound: Accurate Low-bit Quantization for LLMs
- Developed by: The Kaitchup
- Language(s) (NLP): English
- License: cc-by-4.0