NotASI commited on
Commit
7c8497a
1 Parent(s): bd71140

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -2
README.md CHANGED
@@ -2,22 +2,39 @@
2
  base_model: unsloth/Llama-3.2-3B-Instruct-bnb-4bit
3
  language:
4
  - en
5
- license: apache-2.0
6
  tags:
7
  - text-generation-inference
8
  - transformers
9
  - unsloth
10
  - llama
 
11
  - trl
12
  - sft
 
 
13
  ---
14
 
 
 
 
 
 
 
 
 
15
  # Uploaded model
16
 
17
  - **Developed by:** NotASI
18
  - **License:** apache-2.0
19
  - **Finetuned from model :** unsloth/Llama-3.2-3B-Instruct-bnb-4bit
20
 
 
 
 
 
 
 
21
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
2
  base_model: unsloth/Llama-3.2-3B-Instruct-bnb-4bit
3
  language:
4
  - en
5
+ license: llama3.2
6
  tags:
7
  - text-generation-inference
8
  - transformers
9
  - unsloth
10
  - llama
11
+ - llama-3
12
  - trl
13
  - sft
14
+ datasets:
15
+ - mlabonne/FineTome-100k
16
  ---
17
 
18
+ # Notice
19
+
20
+ Model was submitted to OpenLLM Leaderboard for full envaluation.
21
+
22
+ # IMPORTANT
23
+
24
+ In case you got the following error: `exception: data did not match any variant of untagged enum modelwrapper at line 1251003 column 3`. Please upgrade your **transformer** package, that is, use the following code: `pip install --upgrade "transformers>=4.45"`.
25
+
26
  # Uploaded model
27
 
28
  - **Developed by:** NotASI
29
  - **License:** apache-2.0
30
  - **Finetuned from model :** unsloth/Llama-3.2-3B-Instruct-bnb-4bit
31
 
32
+ # Details
33
+
34
+ This model was trained on **mlabonne/FineTome-100k** for *2* epochs with **rslora** + **qlora**, and achieve the final training loss: *0.596400*.
35
+
36
+ This model follows the same chat template as the base model one.
37
+
38
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
39
 
40
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)