RaphaelMourad
commited on
Commit
•
2a4cd8e
1
Parent(s):
b8c3a83
Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ tags:
|
|
9 |
# Model Card for Mistral-Chem-v1-15M (Mistral for chemistry)
|
10 |
|
11 |
The Mistral-Chem-v1-15M Large Language Model (LLM) is a pretrained generative chemical molecule model with 1.9M parameters x 8 experts = 15.2M parameters.
|
12 |
-
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for
|
13 |
The model was pretrained using 10M molecule SMILES strings from the ZINC 15 database.
|
14 |
|
15 |
## Model Architecture
|
|
|
9 |
# Model Card for Mistral-Chem-v1-15M (Mistral for chemistry)
|
10 |
|
11 |
The Mistral-Chem-v1-15M Large Language Model (LLM) is a pretrained generative chemical molecule model with 1.9M parameters x 8 experts = 15.2M parameters.
|
12 |
+
It is derived from Mixtral-8x7B-v0.1 model, which was simplified for molecules: the number of layers and the hidden size were reduced.
|
13 |
The model was pretrained using 10M molecule SMILES strings from the ZINC 15 database.
|
14 |
|
15 |
## Model Architecture
|