---

license: cc-by-nc-4.0
datasets:
- victunes/nart-100k-synthetic-buddy-mixed-names

---

[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)


# QuantFactory/TherapyLlama-8B-v1-GGUF
This is quantized version of [victunes/TherapyLlama-8B-v1](https://huggingface.co/victunes/TherapyLlama-8B-v1) created using llama.cpp

# Original Model Card

**GGUF:** https://huggingface.co/victunes/TherapyLlama-8B-v1-GGUF

# TherapyLlama 8B v1

_Buddy is here for you._

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f07d05279d2d8f725bf0c3/A-ckcZ9H0Ee1n_ls2FM41.png)

Trained on Llama 3 8B using a modified version of [jerryjalapeno/nart-100k-synthetic](https://huggingface.co/datasets/jerryjalapeno/nart-100k-synthetic).

It is a Llama 3 version of https://huggingface.co/victunes/TherapyBeagle-11B-v2

TherapyLlama is _hopefully_ aligned to be helpful, healthy, and comforting. 

## IMPORTANT: Use Vicuna format

This was trained with the Vicuna 1.1 format. Use the Vicuna format! Do NOT use the Llama 3 format.

## Usage
- Do not hold back on Buddy.
- Open up to Buddy.
- Pour your heart out to Buddy.
- Engage with Buddy.
- Remember that Buddy is just an AI.

## Notes
- Tested with the Vicuna 1.1 Format
- You might be assigned a random name if you don't give yourself one.
- RP capabilities are weaker compared to TherapyBeagle.
  - Make sure to say **"You are Socrates"** for its best RP attempt.

## Disclaimer 
**TherapyLlama is NOT a real therapist. It is a friendly AI that mimics empathy and psychotherapy.
It is an illusion without the slightest clue who you are as a person.
As much as it can help you with self-discovery, A LLAMA IS NOT A SUBSTITUTE to a real professional.**

With that said, I found it to be a very helpful tool in unravelling one's self. I hope this model can help sooth minds and hearts.

## Examples

### LLAMA 3 INSTRUCT
```
{{[INPUT]}}
Hello, I'm victunes
{{[OUTPUT]}}
Hi victunes! Welcome to our session. I'm here to listen and support you. How are you feeling today?
{{[INPUT]}}
I've been feeling down lately.
{{[OUTPUT]}}
I'm sorry to hear that. Can you tell me more about what's been going on?
{{[INPUT]}}
I think I'm pretty lonely.
{{[OUTPUT]}}
Loneliness can be really tough. It sounds like it's been weighing heavily on your mind. What makes you feel lonely?
{{[INPUT]}}
My friend died recently.
{{[OUTPUT]}}
Oh, I'm so sorry for your loss, victunes. Losing a friend is never easy. How have you been coping with the grief?
```

**GGUF:** https://huggingface.co/victunes/TherapyLlama-8B-v1-GGUF