Commit
•
4289fbb
1
Parent(s):
e1ea1f5
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,10 +1,8 @@
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
tags:
|
| 4 |
-
- mergekit
|
| 5 |
-
- merge
|
| 6 |
- not-for-all-audiences
|
| 7 |
-
license: llama3
|
| 8 |
language:
|
| 9 |
- en
|
| 10 |
---
|
|
@@ -203,3 +201,4 @@ I chose the weird fiction example to see if the LLM understood a niche genre. It
|
|
| 203 |
|
| 204 |
# Training Strategy
|
| 205 |
|
|
|
|
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
tags:
|
|
|
|
|
|
|
| 4 |
- not-for-all-audiences
|
| 5 |
+
license: llama3.1
|
| 6 |
language:
|
| 7 |
- en
|
| 8 |
---
|
|
|
|
| 201 |
|
| 202 |
# Training Strategy
|
| 203 |
|
| 204 |
+
This was trained with an r 128 qlora over 2 epochs on a mix of public & private datasets using Axolotl.
|