File size: 1,548 Bytes
da36df0 bada313 da36df0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
base_model: Khetterman/AbominationScience-12B-v4
pipeline_tag: text-generation
library_name: transformers
quantized_by: Khetterman
tags:
- mergekit
- merge
- 12b
- chat
- creative
- roleplay
- conversational
- creative-writing
- not-for-all-audiences
language:
- en
- ru
---
# AbominationScience-12B-v4 GGUF Quantizations 🗲
>When the choice is not random.
This model was converted to GGUF format using [llama.cpp](https://github.com/ggerganov/llama.cpp).
For more information of the model, see the original model card: [Khetterman/AbominationScience-12B-v4](https://huggingface.co/Khetterman/AbominationScience-12B-v4).
## Available Quantizations (◕‿◕)
| Type | Quantized GGUF Model | Size |
|--------|----------------------|------|
| Q4_0 | [Khetterman/AbominationScience-12B-v4-Q4_0.gguf](https://huggingface.co/Khetterman/AbominationScience-12B-v4-GGUF/blob/main/AbominationScience-12B-v4-Q4_0.gguf) | 6.58 GiB |
| Q6_K | [Khetterman/AbominationScience-12B-v4-Q6_K.gguf](https://huggingface.co/Khetterman/AbominationScience-12B-v4-GGUF/blob/main/AbominationScience-12B-v4-Q6_K.gguf) | 9.36 GiB |
| Q8_0 | [Khetterman/AbominationScience-12B-v4-Q8_0.gguf](https://huggingface.co/Khetterman/AbominationScience-12B-v4-GGUF/blob/main/AbominationScience-12B-v4-Q8_0.gguf) | 12.1 GiB |
>My thanks to the authors of the original models, your work is incredible. Have a good time 🖤
|