Update README.md
Browse files
README.md
CHANGED
@@ -1,10 +1,17 @@
|
|
1 |
---
|
2 |
license: llama3
|
3 |
base_model: meta-llama/Meta-Llama-3-8B-Instruct
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
---
|
5 |
|
6 |
Meow.
|
7 |
-
|
8 |
|
9 |
|
10 |
|
|
|
1 |
---
|
2 |
license: llama3
|
3 |
base_model: meta-llama/Meta-Llama-3-8B-Instruct
|
4 |
+
datasets:
|
5 |
+
- argilla/distilabel-capybara-dpo-7k-binarized
|
6 |
+
language:
|
7 |
+
- en
|
8 |
+
library_name: transformers
|
9 |
+
tags:
|
10 |
+
- moe
|
11 |
---
|
12 |
|
13 |
Meow.
|
14 |
+
This an experimental mixture of expert model with just 2 experts based on Llama 3 Instruct plain in combo with finetune. Specifically, it is built on top of the Meta-Llama-3-8B-Instruct model and finetune is trained on Argilla Capybara dataset.
|
15 |
|
16 |
|
17 |
|