license:openrail region:us
---
license: openrail
---
# 08/16/2023
lt2_08162023_test_1j used to fine-tune llama-2-7b-chat-tagalog-v0.1. Experiment just to see how much a small dataset can influence the model.

"Taga-llama:
* Noting that traces of Tagalog may be included in pretrained LM's data, touching on how to make use of/invoke whatever the LM has learned from these traces: may also apply to other languages, when dealing with primarily English-trained LMs.
* Acknowledging that fine-tuning, even with bigger datasets cannot 'teach' pretrained models new info such as languages, but can allow us to observe how much a LM is capable of in the target language based on what it may have learned from its data."


