Update README.md
Browse files
README.md
CHANGED
|
@@ -18,7 +18,7 @@ tags:
|
|
| 18 |
|
| 19 |
## 🔧 Training
|
| 20 |
|
| 21 |
-
This model is based on the `
|
| 22 |
|
| 23 |
It was trained using this custom [`finetune_llama2.py`](https://gist.github.com/mlabonne/b5718e1b229ce6553564e3f56df72c5c) script as follows:
|
| 24 |
|
|
|
|
| 18 |
|
| 19 |
## 🔧 Training
|
| 20 |
|
| 21 |
+
This model is based on the `llama-2-7b-chat-hf` model, fine-tuned using QLoRA on the [`mlabonne/CodeLlama-2-20k`](https://huggingface.co/datasets/mlabonne/CodeLlama-2-20k) dataset. It was trained on an RTX 3090 and can be used for inference.
|
| 22 |
|
| 23 |
It was trained using this custom [`finetune_llama2.py`](https://gist.github.com/mlabonne/b5718e1b229ce6553564e3f56df72c5c) script as follows:
|
| 24 |
|