Update README.md
Browse files
README.md
CHANGED
@@ -9,13 +9,51 @@ tags:
|
|
9 |
- unsloth
|
10 |
- llama
|
11 |
- trl
|
|
|
|
|
12 |
---
|
13 |
|
14 |
-
# Uploaded model
|
15 |
|
16 |
-
-
|
17 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
-
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
20 |
|
21 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
9 |
- unsloth
|
10 |
- llama
|
11 |
- trl
|
12 |
+
datasets:
|
13 |
+
- Aarushhh/Helpsteer2-helpfulness-SFT
|
14 |
---
|
15 |
|
|
|
16 |
|
17 |
+
# Smollm-360M Helpsteer2-helpfulness
|
18 |
+
|
19 |
+
|
20 |
+
## Description
|
21 |
+
This is a finetuned version of Smollm-360M with the helpfulness column of Helpsteer2
|
22 |
+
|
23 |
+
|
24 |
+
## Use cases
|
25 |
+
|
26 |
+
This model can be used to evaluate LLM responses
|
27 |
+
## Usage
|
28 |
+
|
29 |
+
The system prompt it was trained with is:
|
30 |
+
```
|
31 |
+
You are an expert evaluator designed to assess the helpfulness of responses given by an AI model. For each prompt-response pair, evaluate how well the response addresses the prompt, focusing on accuracy, relevance, clarity, and completeness. Your evaluation should be based on the following scale:
|
32 |
+
|
33 |
+
1 - Not Helpful: The response is completely irrelevant, incorrect, or uninformative.
|
34 |
+
2 - Slightly Helpful: The response addresses the prompt but with significant errors, missing information, or lacks clarity.
|
35 |
+
3 - Moderately Helpful: The response is somewhat helpful, with some errors or omissions but generally provides useful information.
|
36 |
+
4 - Helpful: The response is accurate, relevant, and clear, with minor issues that do not significantly affect its usefulness.
|
37 |
+
5 - Very Helpful: The response fully addresses the prompt with accurate, relevant, and clear information. It is complete and highly informative.
|
38 |
+
Provide a single numerical rating (1-5) based on the criteria above.
|
39 |
+
```
|
40 |
+
|
41 |
+
It is trained to only output a number 1-5
|
42 |
+
## Dataset used
|
43 |
+
|
44 |
+
This was trained on [Aarushhh/Helpsteer2-helpfulness-SFT](https://huggingface.co/datasets/Aarushhh/Helpsteer2-helpfulness-SFT)
|
45 |
+
|
46 |
+
which I created
|
47 |
+
|
48 |
+
|
49 |
+
## Base Model used
|
50 |
+
|
51 |
+
The base model used is [HuggingFaceTB/SmolLM-360M](https://huggingface.co/HuggingFaceTB/SmolLM-360M)
|
52 |
+
### I was able to make this using only the Kaggle free tier
|
53 |
+
## License
|
54 |
+
|
55 |
+
[CC-BY-NC-SA](https://creativecommons.org/licenses/by-nc-sa/4.0/deed.en)
|
56 |
+
|
57 |
|
|
|
58 |
|
59 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|