ShirinYamani
commited on
Commit
•
2cf8192
1
Parent(s):
751fa5c
Update README.md
Browse files
README.md
CHANGED
@@ -19,6 +19,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
19 |
|
20 |
# llama-3-8-fine-tuned-dora
|
21 |
|
|
|
|
|
22 |
This model is a fine-tuned version of [huggyllama/llama-7b](https://huggingface.co/huggyllama/llama-7b) on on [openassistant-guanaco](https://huggingface.co/datasets/timdettmers/openassistant-guanaco) dataset.
|
23 |
For LoraConfig we set the `use_dora=True` for the Dora decomposition and comparison with Lora.
|
24 |
|
|
|
19 |
|
20 |
# llama-3-8-fine-tuned-dora
|
21 |
|
22 |
+
![huggyllama](https://miro.medium.com/v2/resize:fit:1358/0*UBaord-00Sm4asfW.png)
|
23 |
+
|
24 |
This model is a fine-tuned version of [huggyllama/llama-7b](https://huggingface.co/huggyllama/llama-7b) on on [openassistant-guanaco](https://huggingface.co/datasets/timdettmers/openassistant-guanaco) dataset.
|
25 |
For LoraConfig we set the `use_dora=True` for the Dora decomposition and comparison with Lora.
|
26 |
|