Update README.md
Browse files
README.md
CHANGED
@@ -11,4 +11,30 @@ tags:
|
|
11 |
- trl
|
12 |
---
|
13 |
|
14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
- trl
|
12 |
---
|
13 |
|
14 |
+
# gemma-2-9b-tagalog-chat:
|
15 |
+
* Tagalog model fine-tuned on [this dataset](https://huggingface.co/datasets/922-Narra/tagaloguanaco_cleaned_03152024)
|
16 |
+
* Base: [gemma 2 9b](https://huggingface.co/google/gemma-2-9b-it)
|
17 |
+
* [GGUF](https://huggingface.co/922-Narra/gemma-2-9b-tagalog-chat-gguf)
|
18 |
+
|
19 |
+
### USAGE
|
20 |
+
This model is meant to be a chat model that has better capabilities in Tagalog.
|
21 |
+
|
22 |
+
Best results with "Human" and "Assistant" and prompt with Tagalog. Example:
|
23 |
+
|
24 |
+
"Ito ay isang chat log sa pagitan ng AI Assistant na nagta-Tagalog at isang Pilipino. Magsimula ng chat:\nHuman: Hello po?\nAssistant:"
|
25 |
+
|
26 |
+
### HYPERPARAMS
|
27 |
+
* Trained for 1 epoch
|
28 |
+
* rank: 32
|
29 |
+
* lora alpha: 32
|
30 |
+
* lora dropout: 0
|
31 |
+
* lr: 2e-4
|
32 |
+
* batch size: 2
|
33 |
+
* grad steps: 4
|
34 |
+
|
35 |
+
### WARNINGS AND DISCLAIMERS
|
36 |
+
There is always the chance that the model may hallucinate.
|
37 |
+
|
38 |
+
At times, it may also still switch to English or Taglish (most instances of this occurring when tested for coding).
|
39 |
+
|
40 |
+
Finally, this model is not guaranteed to output aligned or safe outputs nor is it meant for production use - use at your own risk!
|