metadata
base_model: haramberesearch/llama2_xs_460M_uncensored
datasets:
- unalignment/toxic-dpo-v0.1
inference: false
model_creator: haramberesearch
model_name: llama2_xs_460M_uncensored
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- gguf
- ggml
- quantized
- q2_k
- q3_k_m
- q4_k_m
- q5_k_m
- q6_k
- q8_0
haramberesearch/llama2_xs_460M_uncensored-GGUF
Quantized GGUF model files for llama2_xs_460M_uncensored from haramberesearch
| Name | Quant method | Size |
|---|---|---|
| llama2_xs_460m_uncensored.fp16.gguf | fp16 | 925.45 MB |
| llama2_xs_460m_uncensored.q2_k.gguf | q2_k | 212.56 MB |
| llama2_xs_460m_uncensored.q3_k_m.gguf | q3_k_m | 238.87 MB |
| llama2_xs_460m_uncensored.q4_k_m.gguf | q4_k_m | 288.52 MB |
| llama2_xs_460m_uncensored.q5_k_m.gguf | q5_k_m | 333.29 MB |
| llama2_xs_460m_uncensored.q6_k.gguf | q6_k | 380.87 MB |
| llama2_xs_460m_uncensored.q8_0.gguf | q8_0 | 492.67 MB |
Original Model Card:
llama2_xs_460M_uncensored
Model Details
llama2_xs_460M_experimental DPO finedtuned to remove alignment (3 epochs QLoRa).
Model Description
- Developed by: Harambe Research
- Model type: llama2
- Finetuned from model: llama2_xs_460M_experimental
Out-of-Scope Use
Don't use this to do bad things. Bad things are bad.
Recommendations
Users (both direct and downstream) should be aware of the risks, biases and limitations of the model.