afrideva commited on
Commit
1fb3d92
1 Parent(s): 764af66

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +65 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: haramberesearch/llama2_xs_460M_uncensored
3
+ datasets:
4
+ - unalignment/toxic-dpo-v0.1
5
+ inference: false
6
+ model_creator: haramberesearch
7
+ model_name: llama2_xs_460M_uncensored
8
+ pipeline_tag: text-generation
9
+ quantized_by: afrideva
10
+ tags:
11
+ - gguf
12
+ - ggml
13
+ - quantized
14
+ - q2_k
15
+ - q3_k_m
16
+ - q4_k_m
17
+ - q5_k_m
18
+ - q6_k
19
+ - q8_0
20
+ ---
21
+ # haramberesearch/llama2_xs_460M_uncensored-GGUF
22
+
23
+ Quantized GGUF model files for [llama2_xs_460M_uncensored](https://huggingface.co/haramberesearch/llama2_xs_460M_uncensored) from [haramberesearch](https://huggingface.co/haramberesearch)
24
+
25
+
26
+ | Name | Quant method | Size |
27
+ | ---- | ---- | ---- |
28
+ | [llama2_xs_460m_uncensored.fp16.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.fp16.gguf) | fp16 | 925.45 MB |
29
+ | [llama2_xs_460m_uncensored.q2_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q2_k.gguf) | q2_k | 212.56 MB |
30
+ | [llama2_xs_460m_uncensored.q3_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q3_k_m.gguf) | q3_k_m | 238.87 MB |
31
+ | [llama2_xs_460m_uncensored.q4_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q4_k_m.gguf) | q4_k_m | 288.52 MB |
32
+ | [llama2_xs_460m_uncensored.q5_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q5_k_m.gguf) | q5_k_m | 333.29 MB |
33
+ | [llama2_xs_460m_uncensored.q6_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q6_k.gguf) | q6_k | 380.87 MB |
34
+ | [llama2_xs_460m_uncensored.q8_0.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q8_0.gguf) | q8_0 | 492.67 MB |
35
+
36
+
37
+
38
+ ## Original Model Card:
39
+ # llama2_xs_460M_uncensored
40
+ ## Model Details
41
+
42
+ [llama2_xs_460M_experimental](https://huggingface.co/ahxt/llama2_xs_460M_experimental) DPO finedtuned to remove alignment (3 epochs QLoRa).
43
+
44
+ ### Model Description
45
+
46
+ <!-- Provide a longer summary of what this model is. -->
47
+
48
+ - **Developed by:** Harambe Research
49
+ - **Model type:** llama2
50
+ - **Finetuned from model:** [llama2_xs_460M_experimental](https://huggingface.co/ahxt/llama2_xs_460M_experimental)
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ Don't use this to do bad things. Bad things are bad.
55
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
56
+
57
+ ### Recommendations
58
+
59
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
60
+
61
+ Users (both direct and downstream) should be aware of the risks, biases and limitations of the model.
62
+
63
+ ## How to Get Started with the Model
64
+
65
+ https://github.com/oobabooga/text-generation-webui