cgus commited on
Commit
523811f
1 Parent(s): 8abf77a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -3,10 +3,30 @@ license: apache-2.0
3
  language:
4
  - en
5
  pipeline_tag: text-generation
 
 
6
  tags:
7
  - chat
8
  ---
 
 
 
9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  # Qwen2-7B-Instruct-abliterated
11
 
12
  ## Introduction
 
3
  language:
4
  - en
5
  pipeline_tag: text-generation
6
+ base_model: natong19/Qwen2-7B-Instruct-abliterated
7
+ inference: false
8
  tags:
9
  - chat
10
  ---
11
+ # Qwen2-7B-Instruct-abliterated-exl2
12
+ Model: [Qwen2-7B-Instruct-abliterated](https://huggingface.co/natong19/Qwen2-7B-Instruct-abliterated)
13
+ Made by: [natong19](https://huggingface.co/natong19)
14
 
15
+ Based on original model: [Qwen2-7B-Instruct](https://huggingface.co/Qwen/Qwen2-7B-Instruct)
16
+ Created by: [Qwen](https://huggingface.co/Qwen)
17
+
18
+ ## Quants
19
+ [4bpw h6 (main)](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/main)
20
+ [4.25bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/4.25bpw-h6)
21
+ [4.65bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/4.65bpw-h6)
22
+ [5bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/5bpw-h6)
23
+ [6bpw h6](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/6bpw-h6)
24
+ [8bpw h8](https://huggingface.co/cgus/Qwen2-7B-Instruct-abliterated-exl2/tree/8bpw-h8)
25
+
26
+ ## Quantization notes
27
+ Made with Exllamav2 0.1.5 and the default dataset.
28
+
29
+ # Original model card
30
  # Qwen2-7B-Instruct-abliterated
31
 
32
  ## Introduction