End of training

README.md

@@ -6,6 +6,8 @@ tags:
 - sft
 - generated_from_trainer
 base_model: Viet-Mistral/Vistral-7B-Chat
+datasets:
+- generator
 model-index:
 - name: vietnamese-news-summarization-vistral-7b
   results: []
@@ -17,7 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
 [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/tritran/vietnamese-news-summarization/runs/as3mgbsl)
 # vietnamese-news-summarization-vistral-7b
 
-This model is a fine-tuned version of [Viet-Mistral/Vistral-7B-Chat](https://huggingface.co/Viet-Mistral/Vistral-7B-Chat) on an unknown dataset.
+This model is a fine-tuned version of [Viet-Mistral/Vistral-7B-Chat](https://huggingface.co/Viet-Mistral/Vistral-7B-Chat) on the generator dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.2452
 
 ## Model description
 
@@ -45,6 +49,17 @@ The following hyperparameters were used during training:
 - lr_scheduler_warmup_steps: 0.03
 - training_steps: 100
 
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 1.3699        | 0.0060 | 20   | 1.3159          |
+| 1.4501        | 0.0119 | 40   | 1.2761          |
+| 1.2554        | 0.0179 | 60   | 1.2583          |
+| 1.1901        | 0.0239 | 80   | 1.2474          |
+| 1.4126        | 0.0298 | 100  | 1.2452          |
+
+
 ### Framework versions
 
 - PEFT 0.11.1