Update README.md
Browse files
README.md
CHANGED
@@ -3,10 +3,30 @@ license: apache-2.0
|
|
3 |
language:
|
4 |
- en
|
5 |
pipeline_tag: text-generation
|
|
|
|
|
6 |
tags:
|
7 |
- chat
|
8 |
---
|
|
|
|
|
|
|
9 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
# Qwen2-7B-Instruct-abliterated
|
11 |
|
12 |
## Introduction
|
|
|
3 |
language:
|
4 |
- en
|
5 |
pipeline_tag: text-generation
|
6 |
+
base_model: natong19/Qwen2-7B-Instruct-abliterated
|
7 |
+
inference: false
|
8 |
tags:
|
9 |
- chat
|
10 |
---
|
11 |
+
# Qwen2-7B-Instruct-abliterated-exl2
|
12 |
+
Model: [Qwen2-7B-Instruct-abliterated](https://huggingface.co/natong19/Qwen2-7B-Instruct-abliterated)
|
13 |
+
Made by: [natong19](https://huggingface.co/natong19)
|
14 |
|
15 |
+
Based on original model: [Qwen2-7B-Instruct](https://huggingface.co/Qwen/Qwen2-7B-Instruct)
|
16 |
+
Created by: [Qwen](https://huggingface.co/Qwen)
|
17 |
+
|
18 |
+
## Quants
|
19 |
+
[4bpw h6 (main)](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/main)
|
20 |
+
[4.25bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/4.25bpw-h6)
|
21 |
+
[4.65bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/4.65bpw-h6)
|
22 |
+
[5bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/5bpw-h6)
|
23 |
+
[6bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/6bpw-h6)
|
24 |
+
[8bpw h8](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/8bpw-h8)
|
25 |
+
|
26 |
+
## Quantization notes
|
27 |
+
Made with Exllamav2 0.1.5 and the default dataset.
|
28 |
+
|
29 |
+
# Original model card
|
30 |
# Qwen2-7B-Instruct-abliterated
|
31 |
|
32 |
## Introduction
|