RaphaelMourad
commited on
Commit
•
ac6b9d2
1
Parent(s):
c1f959a
Update README.md
Browse files
README.md
CHANGED
@@ -3,13 +3,13 @@ license: apache-2.0
|
|
3 |
tags:
|
4 |
- pretrained
|
5 |
- mistral
|
6 |
-
-
|
7 |
---
|
8 |
|
9 |
# Model Card for Mistral-DNA-v1-17M-hg38 (Mistral for protein)
|
10 |
|
11 |
The Mistral-DNA-v1-17M-hg38 Large Language Model (LLM) is a pretrained generative DNA sequence model with 16.8M parameters.
|
12 |
-
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for
|
13 |
The model was pretrained using 10kb DNA sequences from the hg38 human genome assembly.
|
14 |
|
15 |
## Model Architecture
|
|
|
3 |
tags:
|
4 |
- pretrained
|
5 |
- mistral
|
6 |
+
- DNA
|
7 |
---
|
8 |
|
9 |
# Model Card for Mistral-DNA-v1-17M-hg38 (Mistral for protein)
|
10 |
|
11 |
The Mistral-DNA-v1-17M-hg38 Large Language Model (LLM) is a pretrained generative DNA sequence model with 16.8M parameters.
|
12 |
+
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for DNA: the number of layers and the hidden size were reduced.
|
13 |
The model was pretrained using 10kb DNA sequences from the hg38 human genome assembly.
|
14 |
|
15 |
## Model Architecture
|