922CA commited on
Commit
bc2ffa3
1 Parent(s): 127eab5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -11,4 +11,30 @@ tags:
11
  - trl
12
  ---
13
 
14
- Under testing...
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  - trl
12
  ---
13
 
14
+ # gemma-2-9b-tagalog-chat:
15
+ * Tagalog model fine-tuned on [this dataset](https://huggingface.co/datasets/922-Narra/tagaloguanaco_cleaned_03152024)
16
+ * Base: [gemma 2 9b](https://huggingface.co/google/gemma-2-9b-it)
17
+ * [GGUF](https://huggingface.co/922-Narra/gemma-2-9b-tagalog-chat-gguf)
18
+
19
+ ### USAGE
20
+ This model is meant to be a chat model that has better capabilities in Tagalog.
21
+
22
+ Best results with "Human" and "Assistant" and prompt with Tagalog. Example:
23
+
24
+ "Ito ay isang chat log sa pagitan ng AI Assistant na nagta-Tagalog at isang Pilipino. Magsimula ng chat:\nHuman: Hello po?\nAssistant:"
25
+
26
+ ### HYPERPARAMS
27
+ * Trained for 1 epoch
28
+ * rank: 32
29
+ * lora alpha: 32
30
+ * lora dropout: 0
31
+ * lr: 2e-4
32
+ * batch size: 2
33
+ * grad steps: 4
34
+
35
+ ### WARNINGS AND DISCLAIMERS
36
+ There is always the chance that the model may hallucinate.
37
+
38
+ At times, it may also still switch to English or Taglish (most instances of this occurring when tested for coding).
39
+
40
+ Finally, this model is not guaranteed to output aligned or safe outputs nor is it meant for production use - use at your own risk!