Update README.md
Browse files
README.md
CHANGED
@@ -2,14 +2,36 @@
|
|
2 |
tags:
|
3 |
- autotrain
|
4 |
- text-generation
|
|
|
5 |
widget:
|
6 |
-
- text:
|
7 |
-
license:
|
|
|
|
|
|
|
8 |
---
|
9 |
|
10 |
# Model Trained Using AutoTrain
|
11 |
|
12 |
-
This model was trained using AutoTrain
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
# Usage
|
15 |
|
@@ -17,7 +39,7 @@ This model was trained using AutoTrain. For more information, please visit [Auto
|
|
17 |
import torch
|
18 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
19 |
|
20 |
-
model_path = "GRMenon/
|
21 |
|
22 |
tokenizer = AutoTokenizer.from_pretrained(model_path)
|
23 |
model = AutoModelForCausalLM.from_pretrained(
|
|
|
2 |
tags:
|
3 |
- autotrain
|
4 |
- text-generation
|
5 |
+
- pytorch
|
6 |
widget:
|
7 |
+
- text: 'I love AutoTrain because '
|
8 |
+
license: apache-2.0
|
9 |
+
datasets:
|
10 |
+
- Amod/mental_health_counseling_conversations
|
11 |
+
library_name: peft
|
12 |
---
|
13 |
|
14 |
# Model Trained Using AutoTrain
|
15 |
|
16 |
+
This model was trained using AutoTrain and is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the [mental_health_counseling_conversations](https://huggingface.co/datasets/Amod/mental_health_counseling_conversations) dataset.
|
17 |
+
For more information, please visit [AutoTrain](https://hf.co/docs/autotrain).
|
18 |
+
|
19 |
+
## Model description
|
20 |
+
|
21 |
+
A Mistral-7B-Instruct-v0.2 model finetuned on a corpus of mental health conversations between a psychologist and a user.
|
22 |
+
The intention was to create a mental health assistant, "Connor", to address user questions based on responses from a psychologist.
|
23 |
+
|
24 |
+
## Training data
|
25 |
+
|
26 |
+
The model is finetuned on a corpus of mental health conversations between a psychologist and a client, in the form of context - response pairs. This dataset is a collection of questions and answers sourced from two online counseling and therapy platforms. The questions cover a wide range of mental health topics, and the answers are provided by qualified psychologists.
|
27 |
+
Dataset found here :-
|
28 |
+
* [Kaggle](https://www.kaggle.com/datasets/thedevastator/nlp-mental-health-conversations)
|
29 |
+
* [Huggingface](https://huggingface.co/datasets/Amod/mental_health_counseling_conversations)
|
30 |
+
|
31 |
+
### Training hyperparameters
|
32 |
+
|
33 |
+
The following hyperparameters were used during training:
|
34 |
+
TODO
|
35 |
|
36 |
# Usage
|
37 |
|
|
|
39 |
import torch
|
40 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
41 |
|
42 |
+
model_path = "GRMenon/mental-mistral-7b-instruct-autotrain"
|
43 |
|
44 |
tokenizer = AutoTokenizer.from_pretrained(model_path)
|
45 |
model = AutoModelForCausalLM.from_pretrained(
|