---
language:
- th
- en
---
| Step | Training Loss | Validation Loss |
|------|---------------|-----------------|
| 1000 | 0.978900      | 0.980906        |
| 2000 | 0.699000      | 0.612407        |
| 3000 | 0.478000      | 0.490171        |
| 4000 | 0.362000      | 0.437152        |
| 5000 | 0.333700      | 0.413056        |
| 6000 | 0.333200      | 0.393786        |
| 7000 | 0.324200      | 0.379746        |
| 8000 | 0.297500      | 0.372649        |

QLORA FT using thai dataset ~ 4K on RAG instruction.
Fine tuned on https://huggingface.co/SeaLLMs/SeaLLM-7B-v2